Nov 02 22:51:18 user nova-compute[74721]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74721) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 22:51:18 user nova-compute[74721]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74721) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 22:51:18 user nova-compute[74721]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74721) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 22:51:18 user nova-compute[74721]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 02 22:51:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:51:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:51:18 user nova-compute[74721]: INFO nova.virt.driver [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 02 22:51:19 user nova-compute[74721]: INFO nova.compute.provider_config [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Acquiring lock "singleton_lock" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Acquired lock "singleton_lock" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Releasing lock "singleton_lock" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Full set of CONF: {{(pid=74721) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ******************************************************************************** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Configuration options gathered from: {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ================================================================================ {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] allow_resize_to_same_host      = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] arq_binding_timeout            = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] backdoor_port                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] backdoor_socket                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] block_device_allocate_retries  = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] block_device_allocate_retries_interval = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cert                           = self.pem {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute_monitors               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] config_dir                     = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] config_drive_format            = iso9660 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] config_source                  = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] console_host                   = user {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] control_exchange               = nova {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cpu_allocation_ratio           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] daemon                         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] debug                          = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_access_ip_network_name = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_availability_zone      = nova {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_ephemeral_format       = ext4 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_green_pool_size        = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] default_schedule_zone          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] disk_allocation_ratio          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] enable_new_services            = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] enabled_ssl_apis               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] flat_injected                  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] force_config_drive             = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] force_raw_images               = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] graceful_shutdown_timeout      = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] heal_instance_info_cache_interval = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] host                           = user {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_build_timeout         = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_delete_interval       = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_name_template         = instance-%08x {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_usage_audit           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_usage_audit_period    = month {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] internal_service_availability_zone = internal {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] key                            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] live_migration_retry_count     = 30 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_config_append              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_dir                        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_file                       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_options                    = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_rotate_interval            = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_rotate_interval_type       = days {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] log_rotation_type              = none {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] long_rpc_timeout               = 1800 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_concurrent_builds          = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_concurrent_live_migrations = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_concurrent_snapshots       = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_local_block_devices        = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_logfile_count              = 30 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] max_logfile_size_mb            = 200 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] maximum_instance_delete_attempts = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metadata_listen                = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metadata_listen_port           = 8775 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metadata_workers               = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] migrate_max_retries            = -1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] mkisofs_cmd                    = genisoimage {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] my_ip                          = 10.0.0.210 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] network_allocate_retries       = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] osapi_compute_listen_port      = 8774 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] osapi_compute_unique_server_name_scope =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] osapi_compute_workers          = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] password_length                = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] periodic_enable                = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] periodic_fuzzy_delay           = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] pointer_model                  = ps2mouse {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] preallocate_images             = none {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] publish_errors                 = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] pybasedir                      = /opt/stack/nova {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ram_allocation_ratio           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rate_limit_burst               = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rate_limit_except_level        = CRITICAL {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rate_limit_interval            = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reboot_timeout                 = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reclaim_instance_interval      = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] record                         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reimage_timeout_per_gb         = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] report_interval                = 120 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rescue_timeout                 = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reserved_host_cpus             = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reserved_host_disk_mb          = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reserved_host_memory_mb        = 512 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] reserved_huge_pages            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] resize_confirm_window          = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] resize_fs_using_block_device   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] resume_guests_state_on_host_boot = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rpc_response_timeout           = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] run_external_periodic_tasks    = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] running_deleted_instance_action = reap {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] running_deleted_instance_timeout = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler_instance_sync_interval = 120 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_down_time              = 720 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] servicegroup_driver            = db {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] shelved_offload_time           = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] shelved_poll_interval          = 3600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] shutdown_timeout               = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] source_is_ipv6                 = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ssl_only                       = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] state_path                     = /opt/stack/data/nova {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] sync_power_state_interval      = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] sync_power_state_pool_size     = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] syslog_log_facility            = LOG_USER {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] tempdir                        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] timeout_nbd                    = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] transport_url                  = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] update_resources_interval      = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_cow_images                 = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_eventlog                   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_journal                    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_json                       = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_rootwrap_daemon            = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_stderr                     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] use_syslog                     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vcpu_pin_set                   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plugging_is_fatal          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plugging_timeout           = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] virt_mkfs                      = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] volume_usage_poll_interval     = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] watch_log_file                 = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] web                            = /usr/share/spice-html5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.auth_strategy              = keystone {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.compute_link_prefix        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.dhcp_domain                = novalocal {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.enable_instance_password   = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.glance_link_prefix         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.instance_list_per_project_cells = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.list_records_by_skipping_down_cells = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.local_metadata_per_cell    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.max_limit                  = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.metadata_cache_expiration  = 15 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.neutron_default_tenant_id  = default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.use_forwarded_for          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.use_neutron_default_nets   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_dynamic_targets = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_jsonfile_path   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.backend_argument         = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.config_prefix            = cache.oslo {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.dead_timeout             = 60.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.debug_cache_backend      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.enable_retry_client      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.enable_socket_keepalive  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.enabled                  = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.expiration_time          = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_dead_retry      = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_password        =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_sasl_enabled    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.memcache_username        =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.proxies                  = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.retry_attempts           = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.retry_delay              = 0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.socket_keepalive_count   = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.socket_keepalive_idle    = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.socket_keepalive_interval = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.tls_allowed_ciphers      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.tls_cafile               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.tls_certfile             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.tls_enabled              = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cache.tls_keyfile              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.auth_section            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.auth_type               = password {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.cafile                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.certfile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.collect_timing          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.cross_az_attach         = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.debug                   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.endpoint_template       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.http_retries            = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.insecure                = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.keyfile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.os_region_name          = RegionOne {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.split_loggers           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cinder.timeout                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.cpu_dedicated_set      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.cpu_shared_set         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.image_type_exclude_list = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.resource_provider_association_refresh = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.shutdown_retry_interval = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] conductor.workers              = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] console.allowed_origins        = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] console.ssl_ciphers            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] console.ssl_minimum_version    = default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] consoleauth.token_ttl          = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.cafile                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.certfile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.collect_timing          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.connect_retries         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.connect_retry_delay     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.endpoint_override       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.insecure                = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.keyfile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.max_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.min_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.region_name             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.service_name            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.service_type            = accelerator {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.split_loggers           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.status_code_retries     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.timeout                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] cyborg.version                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.backend               = sqlalchemy {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.connection            = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.connection_debug      = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.connection_parameters =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.connection_recycle_time = 3600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.connection_trace      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.db_inc_retry_interval = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.db_max_retries        = 20 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.db_max_retry_interval = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.db_retry_interval     = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.max_overflow          = 50 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.max_pool_size         = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.max_retries           = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.pool_timeout          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.retry_interval        = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.slave_connection      = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] database.sqlite_synchronous    = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.backend           = sqlalchemy {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.connection        = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.connection_debug  = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.connection_parameters =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.connection_recycle_time = 3600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.connection_trace  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.db_inc_retry_interval = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.db_max_retries    = 20 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.db_max_retry_interval = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.db_retry_interval = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.max_overflow      = 50 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.max_pool_size     = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.max_retries       = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.pool_timeout      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.retry_interval    = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.slave_connection  = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] api_database.sqlite_synchronous = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] devices.enabled_mdev_types     = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ephemeral_storage_encryption.enabled = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.api_servers             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.cafile                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.certfile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.collect_timing          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.connect_retries         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.connect_retry_delay     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.debug                   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.default_trusted_certificate_ids = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.enable_certificate_validation = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.enable_rbd_download     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.endpoint_override       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.insecure                = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.keyfile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.max_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.min_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.num_retries             = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.rbd_ceph_conf           =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.rbd_connect_timeout     = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.rbd_pool                =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.rbd_user                =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.region_name             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.service_name            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.service_type            = image {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.split_loggers           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.status_code_retries     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.timeout                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.verify_glance_signatures = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] glance.version                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] guestfs.debug                  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.config_drive_cdrom      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.config_drive_inject_password = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.enable_remotefx         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.instances_path_share    =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.limit_cpu_features      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.use_multipath_io        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.vswitch_name            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] mks.enabled                    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.manager_interval   = 2400 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.precache_concurrency = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.remove_unused_base_images = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] image_cache.subdirectory_name  = _base {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.api_max_retries         = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.api_retry_interval      = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.auth_section            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.auth_type               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.cafile                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.certfile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.collect_timing          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.conductor_group         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.connect_retries         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.connect_retry_delay     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.endpoint_override       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.insecure                = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.keyfile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.max_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.min_version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.peer_list               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.region_name             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.serial_console_state_timeout = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.service_name            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.service_type            = baremetal {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.split_loggers           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.status_code_retries     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.timeout                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ironic.version                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] key_manager.fixed_key          = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.barbican_api_version  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.barbican_endpoint     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.barbican_endpoint_type = public {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.barbican_region_name  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.cafile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.certfile              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.collect_timing        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.insecure              = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.keyfile               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.number_of_retries     = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.retry_delay           = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.send_service_user_token = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.split_loggers         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.timeout               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.verify_ssl            = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican.verify_ssl_path       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.auth_section = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.auth_type = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.cafile   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.certfile = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.collect_timing = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.insecure = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.keyfile  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.split_loggers = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] barbican_service_user.timeout  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.approle_role_id          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.approle_secret_id        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.cafile                   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.certfile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.collect_timing           = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.insecure                 = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.keyfile                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.kv_mountpoint            = secret {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.kv_path                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.kv_version               = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.namespace                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.root_token_id            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.split_loggers            = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.ssl_ca_crt_file          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.timeout                  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.use_ssl                  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.auth_section          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.auth_type             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.cafile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.certfile              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.collect_timing        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.connect_retries       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.connect_retry_delay   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.endpoint_override     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.insecure              = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.keyfile               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.max_version           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.min_version           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.region_name           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.service_name          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.service_type          = identity {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.split_loggers         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.status_code_retries   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.timeout               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] keystone.version               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.connection_uri         =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_mode               = custom {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: WARNING oslo_config.cfg [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_power_governor_high = performance {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_power_management   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.device_detach_attempts = 8 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.device_detach_timeout  = 20 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.disk_cachemodes        = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.disk_prefix            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.enabled_perf_events    = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.file_backed_memory     = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.gid_maps               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.hw_disk_discard        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.hw_machine_type        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_rbd_pool        = rbd {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_type            = default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.images_volume_group    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.inject_key             = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.inject_partition       = -2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.inject_password        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.iscsi_iface            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.iser_use_multipath     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_downtime = 500 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_inbound_addr = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_scheme  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_timeout_action = abort {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_tunnelled = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: WARNING oslo_config.cfg [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 02 22:51:19 user nova-compute[74721]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 02 22:51:19 user nova-compute[74721]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 02 22:51:19 user nova-compute[74721]: and ``live_migration_inbound_addr`` respectively.
Nov 02 22:51:19 user nova-compute[74721]: ).  Its value may be silently ignored in the future.
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.live_migration_with_native_tls = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.max_queues             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.nfs_mount_options      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_pcie_ports         = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.pmem_namespaces        = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.quobyte_client_cfg     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rbd_secret_uuid        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rbd_user               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rescue_image_id        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rescue_kernel_id       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.rx_queue_size          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.smbfs_mount_options    =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.snapshot_compression   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.snapshot_image_format  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.sparse_logical_volumes = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.swtpm_enabled          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.swtpm_group            = tss {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.swtpm_user             = tss {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.sysinfo_serial         = unique {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.tb_cache_size          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.tx_queue_size          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.uid_maps               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.use_virtio_for_bridges = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.virt_type              = kvm {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.volume_clear           = zero {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.volume_clear_size      = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.volume_use_multipath   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_cache_path   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.auth_section           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.auth_type              = password {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.cafile                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.certfile               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.collect_timing         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.connect_retries        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.connect_retry_delay    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.default_floating_pool  = public {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.endpoint_override      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.extension_sync_interval = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.http_retries           = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.insecure               = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.keyfile                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.max_version            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.min_version            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.ovs_bridge             = br-int {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.physnets               = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.region_name            = RegionOne {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.service_metadata_proxy = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.service_name           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.service_type           = network {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.split_loggers          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.status_code_retries    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.timeout                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] neutron.version                = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] notifications.bdms_in_notifications = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] notifications.default_level    = INFO {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] notifications.notification_format = unversioned {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] notifications.notify_on_state_change = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] pci.alias                      = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] pci.device_spec                = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] pci.report_in_placement        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.auth_section         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.auth_type            = password {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.cafile               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.certfile             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.collect_timing       = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.connect_retries      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.connect_retry_delay  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.default_domain_id    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.default_domain_name  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.domain_id            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.domain_name          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.endpoint_override    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.insecure             = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.keyfile              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.max_version          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.min_version          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.password             = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.project_domain_id    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.project_domain_name  = Default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.project_id           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.project_name         = service {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.region_name          = RegionOne {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.service_name         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.service_type         = placement {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.split_loggers        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.status_code_retries  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.system_scope         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.timeout              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.trust_id             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.user_domain_id       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.user_domain_name     = Default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.user_id              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.username             = placement {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] placement.version              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.cores                    = 20 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.count_usage_from_placement = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.injected_file_content_bytes = 10240 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.injected_file_path_length = 255 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.injected_files           = 5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.instances                = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.key_pairs                = 100 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.metadata_items           = 128 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.ram                      = 51200 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.recheck_quota            = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.server_group_members     = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] quota.server_groups            = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rdp.enabled                    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.image_metadata_prefilter = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.max_attempts         = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.max_placement_results = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] scheduler.workers              = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.host_subset_size = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.isolated_hosts = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.isolated_images = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.pci_in_placement = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.track_instance_changes = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metrics.required               = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metrics.weight_multiplier      = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] metrics.weight_setting         = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.enabled         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.port_range      = 10000:20000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] serial_console.serialproxy_port = 6083 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.auth_section      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.auth_type         = password {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.cafile            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.certfile          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.collect_timing    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.insecure          = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.keyfile           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.send_service_user_token = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.split_loggers     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] service_user.timeout           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.agent_enabled            = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.enabled                  = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.html5proxy_port          = 6082 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.image_compression        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.jpeg_compression         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.playback_compression     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.server_listen            = 127.0.0.1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.streaming_mode           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] spice.zlib_compression         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] upgrade_levels.baseapi         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] upgrade_levels.cert            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] upgrade_levels.compute         = auto {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] upgrade_levels.conductor       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] upgrade_levels.scheduler       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.cafile = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.certfile = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.insecure = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vendordata_dynamic_auth.timeout = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.api_retry_count         = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.ca_file                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.cache_prefix            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.cluster_name            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.connection_pool_size    = 10 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.console_delay_seconds   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.datastore_regex         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.host_ip                 = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.host_password           = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.host_port               = 443 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.host_username           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.insecure                = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.integration_bridge      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.maximum_objects         = 100 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.pbm_default_policy      = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.pbm_enabled             = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.pbm_wsdl_location       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.serial_port_proxy_uri   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.serial_port_service_uri = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.task_poll_interval      = 0.5 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.use_linked_clone        = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.vnc_keymap              = en-us {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.vnc_port                = 5900 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vmware.vnc_port_total          = 10000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.auth_schemes               = ['none'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.enabled                    = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.novncproxy_port            = 6080 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.vencrypt_ca_certs          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.vencrypt_client_cert       = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vnc.vencrypt_client_key        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.disable_rootwrap   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.enable_numa_live_migration = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.libvirt_disable_apic = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.client_socket_timeout     = 900 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.default_pool_size         = 1000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.keep_alive                = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.max_header_line           = 16384 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.ssl_ca_file               = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.ssl_cert_file             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.ssl_key_file              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.tcp_keepidle              = 600 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] zvm.ca_file                    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] zvm.cloud_connector_url        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] zvm.reachable_timeout          = 300 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.enforce_new_defaults = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.enforce_scope      = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.policy_default_rule = default {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.connection_string     = messaging:// {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.enabled               = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.es_doc_type           = notification {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.es_scroll_size        = 10000 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.es_scroll_time        = 2m {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.filter_error_trace    = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.hmac_keys             = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.sentinel_service_name = mymaster {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.socket_timeout        = 0.1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.trace_requests        = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler.trace_sqlalchemy      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler_jaeger.process_tags   = {} {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] profiler_otlp.service_name_prefix = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] remote_debug.host              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] remote_debug.port              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.auth_section        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.auth_type           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.cafile              = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.certfile            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.collect_timing      = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.connect_retries     = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.connect_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.endpoint_id         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.endpoint_override   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.insecure            = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.keyfile             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.max_version         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.min_version         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.region_name         = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.service_name        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.service_type        = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.split_loggers       = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.status_code_retries = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.status_code_retry_delay = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.timeout             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.valid_interfaces    = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_limit.version             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_reports.file_event_handler = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] oslo_reports.log_dir           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.group  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] vif_plug_ovs_privileged.user   = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.isolate_vif         = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] os_brick.lock_path             = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.capabilities   = [21] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.group          = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.helper_command = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] privsep_osbrick.user           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.group           = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.helper_command  = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] nova_sys_admin.user            = None {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG oslo_service.service [None req-3980e080-10c5-49ec-80fe-5ff4af7673f8 None None] ******************************************************************************** {{(pid=74721) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 02 22:51:19 user nova-compute[74721]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Connecting to libvirt: qemu:///system {{(pid=74721) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdf44cc6fe0> {{(pid=74721) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 02 22:51:19 user nova-compute[74721]: libvirt:  error : internal error: could not initialize domain event timer
Nov 02 22:51:19 user nova-compute[74721]: WARNING nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdf44cc6fe0> {{(pid=74721) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Starting native event thread {{(pid=74721) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Starting green dispatch thread {{(pid=74721) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Starting connection event dispatch thread {{(pid=74721) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 02 22:51:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Connection event '1' reason 'None'
Nov 02 22:51:19 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 22:51:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.mount [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Initialising _HostMountState generation 0 {{(pid=74721) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host capabilities <capabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <host>
Nov 02 22:51:27 user nova-compute[74721]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 02 22:51:27 user nova-compute[74721]:     <cpu>
Nov 02 22:51:27 user nova-compute[74721]:       <arch>x86_64</arch>
Nov 02 22:51:27 user nova-compute[74721]:       <model>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <microcode version='1070'/>
Nov 02 22:51:27 user nova-compute[74721]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='osxsave'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='invtsc'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='rsba'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature name='skip-l1dfl-vmentry'/>
Nov 02 22:51:27 user nova-compute[74721]:       <pages unit='KiB' size='4'/>
Nov 02 22:51:27 user nova-compute[74721]:       <pages unit='KiB' size='2048'/>
Nov 02 22:51:27 user nova-compute[74721]:     </cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <power_management>
Nov 02 22:51:27 user nova-compute[74721]:       <suspend_mem/>
Nov 02 22:51:27 user nova-compute[74721]:       <suspend_disk/>
Nov 02 22:51:27 user nova-compute[74721]:       <suspend_hybrid/>
Nov 02 22:51:27 user nova-compute[74721]:     </power_management>
Nov 02 22:51:27 user nova-compute[74721]:     <iommu support='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <migration_features>
Nov 02 22:51:27 user nova-compute[74721]:       <live/>
Nov 02 22:51:27 user nova-compute[74721]:       <uri_transports>
Nov 02 22:51:27 user nova-compute[74721]:         <uri_transport>tcp</uri_transport>
Nov 02 22:51:27 user nova-compute[74721]:         <uri_transport>rdma</uri_transport>
Nov 02 22:51:27 user nova-compute[74721]:       </uri_transports>
Nov 02 22:51:27 user nova-compute[74721]:     </migration_features>
Nov 02 22:51:27 user nova-compute[74721]:     <topology>
Nov 02 22:51:27 user nova-compute[74721]:       <cells num='2'>
Nov 02 22:51:27 user nova-compute[74721]:         <cell id='0'>
Nov 02 22:51:27 user nova-compute[74721]:           <memory unit='KiB'>8140616</memory>
Nov 02 22:51:27 user nova-compute[74721]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 02 22:51:27 user nova-compute[74721]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 22:51:27 user nova-compute[74721]:           <distances>
Nov 02 22:51:27 user nova-compute[74721]:             <sibling id='0' value='10'/>
Nov 02 22:51:27 user nova-compute[74721]:             <sibling id='1' value='20'/>
Nov 02 22:51:27 user nova-compute[74721]:           </distances>
Nov 02 22:51:27 user nova-compute[74721]:           <cpus num='6'>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 02 22:51:27 user nova-compute[74721]:           </cpus>
Nov 02 22:51:27 user nova-compute[74721]:         </cell>
Nov 02 22:51:27 user nova-compute[74721]:         <cell id='1'>
Nov 02 22:51:27 user nova-compute[74721]:           <memory unit='KiB'>8255100</memory>
Nov 02 22:51:27 user nova-compute[74721]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 02 22:51:27 user nova-compute[74721]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 22:51:27 user nova-compute[74721]:           <distances>
Nov 02 22:51:27 user nova-compute[74721]:             <sibling id='0' value='20'/>
Nov 02 22:51:27 user nova-compute[74721]:             <sibling id='1' value='10'/>
Nov 02 22:51:27 user nova-compute[74721]:           </distances>
Nov 02 22:51:27 user nova-compute[74721]:           <cpus num='6'>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 02 22:51:27 user nova-compute[74721]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 02 22:51:27 user nova-compute[74721]:           </cpus>
Nov 02 22:51:27 user nova-compute[74721]:         </cell>
Nov 02 22:51:27 user nova-compute[74721]:       </cells>
Nov 02 22:51:27 user nova-compute[74721]:     </topology>
Nov 02 22:51:27 user nova-compute[74721]:     <cache>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 02 22:51:27 user nova-compute[74721]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 02 22:51:27 user nova-compute[74721]:     </cache>
Nov 02 22:51:27 user nova-compute[74721]:     <secmodel>
Nov 02 22:51:27 user nova-compute[74721]:       <model>apparmor</model>
Nov 02 22:51:27 user nova-compute[74721]:       <doi>0</doi>
Nov 02 22:51:27 user nova-compute[74721]:     </secmodel>
Nov 02 22:51:27 user nova-compute[74721]:     <secmodel>
Nov 02 22:51:27 user nova-compute[74721]:       <model>dac</model>
Nov 02 22:51:27 user nova-compute[74721]:       <doi>0</doi>
Nov 02 22:51:27 user nova-compute[74721]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 02 22:51:27 user nova-compute[74721]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 02 22:51:27 user nova-compute[74721]:     </secmodel>
Nov 02 22:51:27 user nova-compute[74721]:   </host>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='alpha'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>clipper</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='armv6l'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>spitz</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>nuri</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>kzm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>z2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>tosa</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n810</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>terrier</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>midway</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>microbit</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>verdex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>highbank</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>akita</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>connex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>collie</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='armv7l'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>spitz</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>nuri</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>kzm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>z2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>tosa</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n810</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>terrier</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>midway</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>microbit</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>verdex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>highbank</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>akita</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>connex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>collie</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='aarch64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>spitz</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>nuri</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>kzm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>z2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>tosa</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n810</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>n800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>terrier</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>midway</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>microbit</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>verdex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>raspi3b</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>highbank</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>akita</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>connex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>collie</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <acpi default='on' toggle='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='cris'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='i686'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>isapc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>microvm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='kvm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <pae/>
Nov 02 22:51:27 user nova-compute[74721]:       <nonpae/>
Nov 02 22:51:27 user nova-compute[74721]:       <acpi default='on' toggle='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:       <apic default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='m68k'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>an5206</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>q800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>next-cube</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='microblaze'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='microblazeel'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='mips'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>malta</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='mipsel'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>malta</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='mips64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>malta</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>pica61</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>magnum</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='mips64el'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>malta</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>pica61</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>magnum</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='16'>boston</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='ppc'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mac99</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>40p</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>taihu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='ppc64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>taihu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>40p</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mac99</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='ppc64le'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>taihu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>40p</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>mac99</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='riscv32'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='8'>spike</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>opentitan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='8'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='riscv64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='8'>spike</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>shakti_c</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='8'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='s390x'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='sh4'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>shix</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>r2d</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='sh4eb'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>shix</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>r2d</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='sparc'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>SS-5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>SS-20</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>LX</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>SS-4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>SS-10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>Voyager</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='sparc64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sun4u</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>niagara</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>sun4v</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='x86_64'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>64</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='1'>isapc</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>microvm</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='kvm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <acpi default='on' toggle='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:       <apic default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='xtensa'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>sim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>kc705</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ml605</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx200</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx60</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]:   <guest>
Nov 02 22:51:27 user nova-compute[74721]:     <os_type>hvm</os_type>
Nov 02 22:51:27 user nova-compute[74721]:     <arch name='xtensaeb'>
Nov 02 22:51:27 user nova-compute[74721]:       <wordsize>32</wordsize>
Nov 02 22:51:27 user nova-compute[74721]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='4'>sim</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>kc705</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ml605</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>virt</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx200</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>lx60</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 22:51:27 user nova-compute[74721]:       <domain type='qemu'/>
Nov 02 22:51:27 user nova-compute[74721]:     </arch>
Nov 02 22:51:27 user nova-compute[74721]:     <features>
Nov 02 22:51:27 user nova-compute[74721]:       <cpuselection/>
Nov 02 22:51:27 user nova-compute[74721]:       <deviceboot/>
Nov 02 22:51:27 user nova-compute[74721]:       <disksnapshot default='on' toggle='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     </features>
Nov 02 22:51:27 user nova-compute[74721]:   </guest>
Nov 02 22:51:27 user nova-compute[74721]: </capabilities>
Nov 02 22:51:27 user nova-compute[74721]: 
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-q35-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>i686</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='288'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'/>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='lm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-i440fx-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>i686</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='255'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'/>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='lm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ide</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-q35-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>i686</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='288'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'/>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='lm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-i440fx-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>i686</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='255'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'/>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='lm'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ide</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-q35-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>x86_64</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='288'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>efi</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='invtsc'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='rsba'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-i440fx-6.2</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>x86_64</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='255'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>efi</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='invtsc'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='rsba'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ide</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-q35-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>x86_64</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='288'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>efi</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='invtsc'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='rsba'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 02 22:51:27 user nova-compute[74721]: <domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 22:51:27 user nova-compute[74721]:   <domain>kvm</domain>
Nov 02 22:51:27 user nova-compute[74721]:   <machine>pc-i440fx-jammy</machine>
Nov 02 22:51:27 user nova-compute[74721]:   <arch>x86_64</arch>
Nov 02 22:51:27 user nova-compute[74721]:   <vcpu max='255'/>
Nov 02 22:51:27 user nova-compute[74721]:   <iothreads supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:   <os supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='firmware'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>efi</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:     <loader supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>rom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pflash</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='readonly'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>yes</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='secure'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>no</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </loader>
Nov 02 22:51:27 user nova-compute[74721]:   </os>
Nov 02 22:51:27 user nova-compute[74721]:   <cpu>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-passthrough' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='hostPassthroughMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='maximum' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='maximumMigratable'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>on</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>off</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='host-model' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <vendor>Intel</vendor>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ss'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='vmx'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pcid'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='hypervisor'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arat'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='umip'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='md-clear'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='invtsc'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibpb'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='ibrs'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-stibp'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='rsba'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='erms'/>
Nov 02 22:51:27 user nova-compute[74721]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:     <mode name='custom' supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>qemu64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>qemu32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>phenom</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>pentium</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>n270</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm64</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>kvm32</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>coreduo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>core2duo</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>athlon</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Westmere</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Snowridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Skylake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>SandyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Penryn</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G5</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G4</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G3</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Opteron_G2</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Opteron_G1</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>IvyBridge</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Icelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Haswell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Rome</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-Milan</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>EPYC</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Dhyana</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cooperlake</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>Conroe</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='no'>Broadwell</model>
Nov 02 22:51:27 user nova-compute[74721]:       <model usable='yes'>486</model>
Nov 02 22:51:27 user nova-compute[74721]:     </mode>
Nov 02 22:51:27 user nova-compute[74721]:   </cpu>
Nov 02 22:51:27 user nova-compute[74721]:   <memoryBacking supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:     <enum name='sourceType'>
Nov 02 22:51:27 user nova-compute[74721]:       <value>file</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>anonymous</value>
Nov 02 22:51:27 user nova-compute[74721]:       <value>memfd</value>
Nov 02 22:51:27 user nova-compute[74721]:     </enum>
Nov 02 22:51:27 user nova-compute[74721]:   </memoryBacking>
Nov 02 22:51:27 user nova-compute[74721]:   <devices>
Nov 02 22:51:27 user nova-compute[74721]:     <disk supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='diskDevice'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>disk</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cdrom</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>floppy</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>lun</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='bus'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ide</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>fdc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sata</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </disk>
Nov 02 22:51:27 user nova-compute[74721]:     <graphics supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='type'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>sdl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vnc</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>spice</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egl-headless</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </graphics>
Nov 02 22:51:27 user nova-compute[74721]:     <video supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='modelType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>cirrus</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>vmvga</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>qxl</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>none</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>bochs</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>ramfb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </video>
Nov 02 22:51:27 user nova-compute[74721]:     <hostdev supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='mode'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>subsystem</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='startupPolicy'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>default</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>mandatory</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>requisite</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>optional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='subsysType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>usb</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>pci</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>scsi</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='capsType'/>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='pciBackend'/>
Nov 02 22:51:27 user nova-compute[74721]:     </hostdev>
Nov 02 22:51:27 user nova-compute[74721]:     <rng supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtio-non-transitional</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>random</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>egd</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>builtin</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </rng>
Nov 02 22:51:27 user nova-compute[74721]:     <filesystem supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='driverType'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>path</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>handle</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>virtiofs</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </filesystem>
Nov 02 22:51:27 user nova-compute[74721]:     <tpm supported='yes'>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='model'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-tis</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>tpm-crb</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:       <enum name='backendModel'>
Nov 02 22:51:27 user nova-compute[74721]:         <value>passthrough</value>
Nov 02 22:51:27 user nova-compute[74721]:         <value>emulator</value>
Nov 02 22:51:27 user nova-compute[74721]:       </enum>
Nov 02 22:51:27 user nova-compute[74721]:     </tpm>
Nov 02 22:51:27 user nova-compute[74721]:   </devices>
Nov 02 22:51:27 user nova-compute[74721]:   <features>
Nov 02 22:51:27 user nova-compute[74721]:     <gic supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:     <vmcoreinfo supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <genid supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backingStoreInput supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <backup supported='yes'/>
Nov 02 22:51:27 user nova-compute[74721]:     <sev supported='no'/>
Nov 02 22:51:27 user nova-compute[74721]:   </features>
Nov 02 22:51:27 user nova-compute[74721]: </domainCapabilities>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74721) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74721) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Checking secure boot support for host arch (x86_64) {{(pid=74721) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Secure Boot support detected
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] cpu compare xml: <cpu match="exact">
Nov 02 22:51:27 user nova-compute[74721]:   <model>Nehalem</model>
Nov 02 22:51:27 user nova-compute[74721]: </cpu>
Nov 02 22:51:27 user nova-compute[74721]:  {{(pid=74721) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.virt.node [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Generated node identity ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.virt.node [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Wrote node identity ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b to /opt/stack/data/nova/compute_id
Nov 02 22:51:27 user nova-compute[74721]: WARNING nova.compute.manager [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Compute nodes ['ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.compute.manager [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 02 22:51:27 user nova-compute[74721]: WARNING nova.compute.manager [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 22:51:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:51:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:51:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Hypervisor/Node resource view: name=user free_ram=10982MB free_disk=26.22643280029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:51:27 user nova-compute[74721]: WARNING nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] No compute node record for user:ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b could not be found.
Nov 02 22:51:27 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Compute node record created for user:user with uuid: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:51:27 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:51:28 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] [req-5097f36c-c2bb-4805-be3e-24f8d13d92dd] Created resource provider record via placement API for resource provider with UUID ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b and name user.
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74721) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 02 22:51:28 user nova-compute[74721]: INFO nova.virt.libvirt.host [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] kernel doesn't support AMD SEV
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Libvirt baseline CPU <cpu>
Nov 02 22:51:28 user nova-compute[74721]:   <arch>x86_64</arch>
Nov 02 22:51:28 user nova-compute[74721]:   <model>Nehalem</model>
Nov 02 22:51:28 user nova-compute[74721]:   <vendor>Intel</vendor>
Nov 02 22:51:28 user nova-compute[74721]:   <topology sockets="6" cores="1" threads="1"/>
Nov 02 22:51:28 user nova-compute[74721]: </cpu>
Nov 02 22:51:28 user nova-compute[74721]:  {{(pid=74721) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Updated inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Updating resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b generation from 0 to 1 during operation: update_inventory {{(pid=74721) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Updating resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b generation from 1 to 2 during operation: update_traits {{(pid=74721) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.service [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Creating RPC server for service compute {{(pid=74721) start /opt/stack/nova/nova/service.py:182}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.service [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] Join ServiceGroup membership for this service compute {{(pid=74721) start /opt/stack/nova/nova/service.py:199}}
Nov 02 22:51:28 user nova-compute[74721]: DEBUG nova.servicegroup.drivers.db [None req-3795a308-1de1-4ccb-8268-43a1edb1cf01 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74721) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 02 22:52:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_power_states {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:52:18 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:52:19 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:52:19 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=10387MB free_disk=26.130264282226562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:52:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:53:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:53:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:53:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=10333MB free_disk=26.187400817871094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:53:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:53:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:54:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:54:19 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:54:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:54:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=10374MB free_disk=25.947998046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:54:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:54:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:54:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:54:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:55:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 22:55:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 22:55:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:21 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:55:22 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:22 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=9621MB free_disk=25.97549819946289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:55:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:32 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:55:32 user nova-compute[74721]: INFO nova.compute.claims [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Claim successful on node user
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:55:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:55:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Creating image(s)
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.policy [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c9bbcabb56f4e58b533c7249824bfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d1f14597a747e7861bd5804f741326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.virt.images [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] bf81f74d-ac5b-4b08-8444-661e551c1f11 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.part /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:55:34 user nova-compute[74721]: INFO nova.compute.claims [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Claim successful on node user
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.part /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.converted" returned: 0 in 0.318s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.393s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:34 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkt7570u_/privsep.sock']
Nov 02 22:55:34 user sudo[84208]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkt7570u_/privsep.sock
Nov 02 22:55:34 user sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:55:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:55:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:55:35 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Creating image(s)
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG nova.policy [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '821e324c9ed4485dbb9fd3d2200b6427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc43b8d380f489291403f7300e9a48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:35 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:55:35 user nova-compute[74721]: INFO nova.compute.claims [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Claim successful on node user
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:55:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:55:36 user sudo[84208]: pam_unix(sudo:session): session closed for user root
Nov 02 22:55:36 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Spawned new privsep daemon via rootwrap
Nov 02 22:55:36 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 22:55:36 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 22:55:36 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 22:55:36 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84213
Nov 02 22:55:36 user nova-compute[74721]: WARNING oslo_privsep.priv_context [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] privsep daemon already running
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.policy [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce9460acd644a25a9c32ade02941243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca4498dfb724e13ba1086d4e687d1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:55:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Creating image(s)
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk 1073741824" returned: 0 in 0.044s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Successfully created port: 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.228s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk 1073741824" returned: 0 in 0.050s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.442s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Cannot resize image /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Ensure instance console log exists: /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk 1073741824" returned: 0 in 0.047s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Cannot resize image /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Ensure instance console log exists: /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Successfully created port: e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Cannot resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Ensure instance console log exists: /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:37 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:55:37 user nova-compute[74721]: INFO nova.compute.claims [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Claim successful on node user
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:55:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:55:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Creating image(s)
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Successfully created port: d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG nova.policy [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d3fb4cd21c349a1b60f075ffa63f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9ed314de1541b6854e6158ee0816a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.154s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk 1073741824" returned: 0 in 0.041s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Cannot resize image /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Ensure instance console log exists: /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Successfully updated port: 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing instance network info cache due to event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Successfully updated port: e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:55:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance network_info: |[{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start _get_guest_xml network_info=[{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:55:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1030411833',display_name='tempest-ServerStableDeviceRescueTest-server-1030411833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1030411833',id=1,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNIZDD8fSNOHfbgmvPWgQYpuaaFUt9Y9aHT0Ls1/1zORqHXG2VLjhoJgSljiBLih0CzZJOocC8cPPiKkVNHaXqEfB8yvxOL1648swx/iSRx+hKVxo6dqgFdibBckJG9aQ==',key_name='tempest-keypair-593836985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1f14597a747e7861bd5804f741326',ramdisk_id='',reservation_id='r-a3o4h2d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1520146931',owner_user_name='tempest-ServerStableDeviceRescueTest-1520146931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9bbcabb56f4e58b533c7249824bfc6',uuid=2bd27de5-1593-4d0e-981a-766ca5bc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converting VIF {"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:55:40 user nova-compute[74721]:   <uuid>2bd27de5-1593-4d0e-981a-766ca5bc052a</uuid>
Nov 02 22:55:40 user nova-compute[74721]:   <name>instance-00000001</name>
Nov 02 22:55:40 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:55:40 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:55:40 user nova-compute[74721]:   <metadata>
Nov 02 22:55:40 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:55:40 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1030411833</nova:name>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:55:40</nova:creationTime>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:55:40 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:owner>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:user uuid="8c9bbcabb56f4e58b533c7249824bfc6">tempest-ServerStableDeviceRescueTest-1520146931-project-member</nova:user>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:project uuid="17d1f14597a747e7861bd5804f741326">tempest-ServerStableDeviceRescueTest-1520146931</nova:project>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:owner>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:ports>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:port uuid="1d4d3068-1dfb-4c8f-9162-2d807dc11302">
Nov 02 22:55:40 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 22:55:40 user nova-compute[74721]:         </nova:port>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:ports>
Nov 02 22:55:40 user nova-compute[74721]:     </nova:instance>
Nov 02 22:55:40 user nova-compute[74721]:   </metadata>
Nov 02 22:55:40 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:55:40 user nova-compute[74721]:     <system>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="serial">2bd27de5-1593-4d0e-981a-766ca5bc052a</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="uuid">2bd27de5-1593-4d0e-981a-766ca5bc052a</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:55:40 user nova-compute[74721]:     </system>
Nov 02 22:55:40 user nova-compute[74721]:   </sysinfo>
Nov 02 22:55:40 user nova-compute[74721]:   <os>
Nov 02 22:55:40 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:55:40 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:55:40 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:55:40 user nova-compute[74721]:   </os>
Nov 02 22:55:40 user nova-compute[74721]:   <features>
Nov 02 22:55:40 user nova-compute[74721]:     <acpi/>
Nov 02 22:55:40 user nova-compute[74721]:     <apic/>
Nov 02 22:55:40 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:55:40 user nova-compute[74721]:   </features>
Nov 02 22:55:40 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:55:40 user nova-compute[74721]:   </clock>
Nov 02 22:55:40 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:55:40 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:55:40 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:55:40 user nova-compute[74721]:   </cpu>
Nov 02 22:55:40 user nova-compute[74721]:   <devices>
Nov 02 22:55:40 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:55:40 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:55:40 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk"/>
Nov 02 22:55:40 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:     </disk>
Nov 02 22:55:40 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:55:40 user nova-compute[74721]:       <mac address="fa:16:3e:cc:97:7f"/>
Nov 02 22:55:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:55:40 user nova-compute[74721]:       <target dev="tap1d4d3068-1d"/>
Nov 02 22:55:40 user nova-compute[74721]:     </interface>
Nov 02 22:55:40 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:55:40 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/console.log" append="off"/>
Nov 02 22:55:40 user nova-compute[74721]:     </serial>
Nov 02 22:55:40 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:55:40 user nova-compute[74721]:     <video>
Nov 02 22:55:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:     </video>
Nov 02 22:55:40 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:55:40 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:55:40 user nova-compute[74721]:     </rng>
Nov 02 22:55:40 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:55:40 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:55:40 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:55:40 user nova-compute[74721]:     </memballoon>
Nov 02 22:55:40 user nova-compute[74721]:   </devices>
Nov 02 22:55:40 user nova-compute[74721]: </domain>
Nov 02 22:55:40 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1030411833',display_name='tempest-ServerStableDeviceRescueTest-server-1030411833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1030411833',id=1,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNIZDD8fSNOHfbgmvPWgQYpuaaFUt9Y9aHT0Ls1/1zORqHXG2VLjhoJgSljiBLih0CzZJOocC8cPPiKkVNHaXqEfB8yvxOL1648swx/iSRx+hKVxo6dqgFdibBckJG9aQ==',key_name='tempest-keypair-593836985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1f14597a747e7861bd5804f741326',ramdisk_id='',reservation_id='r-a3o4h2d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1520146931',owner_user_name='tempest-ServerStableDeviceRescueTest-1520146931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9bbcabb56f4e58b533c7249824bfc6',uuid=2bd27de5-1593-4d0e-981a-766ca5bc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converting VIF {"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG os_vif [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Created schema index Interface.name {{(pid=74721) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Created schema index Port.name {{(pid=74721) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Created schema index Bridge.name {{(pid=74721) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [POLLOUT] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance network_info: |[{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start _get_guest_xml network_info=[{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3cea0e2-db73-51d6-a03e-3774bdae0459', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:40 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpprpvinot/privsep.sock']
Nov 02 22:55:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:55:40 user sudo[84279]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpprpvinot/privsep.sock
Nov 02 22:55:40 user sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'pci_devices' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:55:40 user nova-compute[74721]:   <uuid>bb70b80b-ebf8-4962-afa2-49de93c5b3af</uuid>
Nov 02 22:55:40 user nova-compute[74721]:   <name>instance-00000002</name>
Nov 02 22:55:40 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:55:40 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:55:40 user nova-compute[74721]:   <metadata>
Nov 02 22:55:40 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:55:40 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherB-server-639869915</nova:name>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:55:40</nova:creationTime>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:55:40 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:owner>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:user uuid="821e324c9ed4485dbb9fd3d2200b6427">tempest-ServerActionsTestOtherB-371613091-project-member</nova:user>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:project uuid="2fc43b8d380f489291403f7300e9a48c">tempest-ServerActionsTestOtherB-371613091</nova:project>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:owner>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:55:40 user nova-compute[74721]:       <nova:ports>
Nov 02 22:55:40 user nova-compute[74721]:         <nova:port uuid="e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd">
Nov 02 22:55:40 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 22:55:40 user nova-compute[74721]:         </nova:port>
Nov 02 22:55:40 user nova-compute[74721]:       </nova:ports>
Nov 02 22:55:40 user nova-compute[74721]:     </nova:instance>
Nov 02 22:55:40 user nova-compute[74721]:   </metadata>
Nov 02 22:55:40 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:55:40 user nova-compute[74721]:     <system>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="serial">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="uuid">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 22:55:40 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:55:40 user nova-compute[74721]:     </system>
Nov 02 22:55:40 user nova-compute[74721]:   </sysinfo>
Nov 02 22:55:40 user nova-compute[74721]:   <os>
Nov 02 22:55:40 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:55:40 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:55:40 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:55:40 user nova-compute[74721]:   </os>
Nov 02 22:55:40 user nova-compute[74721]:   <features>
Nov 02 22:55:40 user nova-compute[74721]:     <acpi/>
Nov 02 22:55:40 user nova-compute[74721]:     <apic/>
Nov 02 22:55:40 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:55:40 user nova-compute[74721]:   </features>
Nov 02 22:55:40 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:55:40 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:55:40 user nova-compute[74721]:   </clock>
Nov 02 22:55:40 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:55:40 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:55:40 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:55:40 user nova-compute[74721]:   </cpu>
Nov 02 22:55:40 user nova-compute[74721]:   <devices>
Nov 02 22:55:40 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:55:40 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:55:40 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk"/>
Nov 02 22:55:40 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:     </disk>
Nov 02 22:55:40 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:55:40 user nova-compute[74721]:       <mac address="fa:16:3e:04:f7:98"/>
Nov 02 22:55:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:55:40 user nova-compute[74721]:       <target dev="tape4e4d474-9e"/>
Nov 02 22:55:40 user nova-compute[74721]:     </interface>
Nov 02 22:55:40 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:55:40 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/console.log" append="off"/>
Nov 02 22:55:40 user nova-compute[74721]:     </serial>
Nov 02 22:55:40 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:55:40 user nova-compute[74721]:     <video>
Nov 02 22:55:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:40 user nova-compute[74721]:     </video>
Nov 02 22:55:40 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:55:40 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:55:40 user nova-compute[74721]:     </rng>
Nov 02 22:55:40 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:55:40 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:55:40 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:55:40 user nova-compute[74721]:     </memballoon>
Nov 02 22:55:40 user nova-compute[74721]:   </devices>
Nov 02 22:55:40 user nova-compute[74721]: </domain>
Nov 02 22:55:40 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG os_vif [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25be48b0-36bf-5e38-83b4-c5aa20750405', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Successfully created port: 923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated VIF entry in instance network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e805485-c5a4-489a-8cf9-1a107c93e50a req-323fc0ff-107f-40aa-8120-6f1f5d26f0fe service nova] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Successfully updated port: d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-changed-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Refreshing instance network info cache due to event network-changed-d0b517f6-e930-4e60-8193-2aa28648ac45. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-changed-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Refreshing instance network info cache due to event network-changed-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Refreshing network info cache for port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:55:42 user sudo[84279]: pam_unix(sudo:session): session closed for user root
Nov 02 22:55:42 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Spawned new privsep daemon via rootwrap
Nov 02 22:55:42 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 22:55:42 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 22:55:42 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 02 22:55:42 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84284
Nov 02 22:55:42 user nova-compute[74721]: WARNING oslo_privsep.priv_context [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] privsep daemon already running
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updated VIF entry in instance network info cache for port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d77e0271-559c-4250-bf18-8ed3687d23b7 req-37e1c6ec-a200-43b1-9e5a-54860dbae508 service nova] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4d474-9e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4e4d474-9e, col_values=(('qos', UUID('86d0795d-8f26-4e7d-b851-cebd90f07359')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4e4d474-9e, col_values=(('external_ids', {'iface-id': 'e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f7:98', 'vm-uuid': 'bb70b80b-ebf8-4962-afa2-49de93c5b3af'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: INFO os_vif [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4d3068-1d, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d4d3068-1d, col_values=(('qos', UUID('1b6fdd86-58c9-490c-9785-fd9a6d06e0ea')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d4d3068-1d, col_values=(('external_ids', {'iface-id': '1d4d3068-1dfb-4c8f-9162-2d807dc11302', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:97:7f', 'vm-uuid': '2bd27de5-1593-4d0e-981a-766ca5bc052a'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: INFO os_vif [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d')
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No VIF found with MAC fa:16:3e:04:f7:98, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance network_info: |[{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Refreshing network info cache for port d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start _get_guest_xml network_info=[{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:55:42 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:42 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No VIF found with MAC fa:16:3e:cc:97:7f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:55:42 user nova-compute[74721]:   <uuid>80e598d8-a24f-412f-a083-3de7b0b853b3</uuid>
Nov 02 22:55:42 user nova-compute[74721]:   <name>instance-00000003</name>
Nov 02 22:55:42 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:55:42 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:55:42 user nova-compute[74721]:   <metadata>
Nov 02 22:55:42 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:55:42 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeTestJSON-server-758223653</nova:name>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:55:42</nova:creationTime>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:55:42 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:55:42 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:owner>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:user uuid="6ce9460acd644a25a9c32ade02941243">tempest-AttachVolumeTestJSON-1894655503-project-member</nova:user>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:project uuid="bca4498dfb724e13ba1086d4e687d1ef">tempest-AttachVolumeTestJSON-1894655503</nova:project>
Nov 02 22:55:42 user nova-compute[74721]:       </nova:owner>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:55:42 user nova-compute[74721]:       <nova:ports>
Nov 02 22:55:42 user nova-compute[74721]:         <nova:port uuid="d0b517f6-e930-4e60-8193-2aa28648ac45">
Nov 02 22:55:42 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 22:55:42 user nova-compute[74721]:         </nova:port>
Nov 02 22:55:42 user nova-compute[74721]:       </nova:ports>
Nov 02 22:55:42 user nova-compute[74721]:     </nova:instance>
Nov 02 22:55:42 user nova-compute[74721]:   </metadata>
Nov 02 22:55:42 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:55:42 user nova-compute[74721]:     <system>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="serial">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="uuid">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 22:55:42 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:55:42 user nova-compute[74721]:     </system>
Nov 02 22:55:42 user nova-compute[74721]:   </sysinfo>
Nov 02 22:55:42 user nova-compute[74721]:   <os>
Nov 02 22:55:42 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:55:42 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:55:42 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:55:42 user nova-compute[74721]:   </os>
Nov 02 22:55:42 user nova-compute[74721]:   <features>
Nov 02 22:55:42 user nova-compute[74721]:     <acpi/>
Nov 02 22:55:42 user nova-compute[74721]:     <apic/>
Nov 02 22:55:42 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:55:42 user nova-compute[74721]:   </features>
Nov 02 22:55:42 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:55:42 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:55:42 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:55:42 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:55:42 user nova-compute[74721]:   </clock>
Nov 02 22:55:42 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:55:42 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:55:42 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:55:42 user nova-compute[74721]:   </cpu>
Nov 02 22:55:42 user nova-compute[74721]:   <devices>
Nov 02 22:55:42 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:55:42 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:55:42 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk"/>
Nov 02 22:55:42 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:55:42 user nova-compute[74721]:     </disk>
Nov 02 22:55:42 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:55:42 user nova-compute[74721]:       <mac address="fa:16:3e:ce:ca:8f"/>
Nov 02 22:55:42 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:42 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:55:42 user nova-compute[74721]:       <target dev="tapd0b517f6-e9"/>
Nov 02 22:55:42 user nova-compute[74721]:     </interface>
Nov 02 22:55:42 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:55:42 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/console.log" append="off"/>
Nov 02 22:55:42 user nova-compute[74721]:     </serial>
Nov 02 22:55:42 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:55:42 user nova-compute[74721]:     <video>
Nov 02 22:55:42 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:42 user nova-compute[74721]:     </video>
Nov 02 22:55:42 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:55:42 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:55:42 user nova-compute[74721]:     </rng>
Nov 02 22:55:42 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:55:42 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:55:42 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:55:42 user nova-compute[74721]:     </memballoon>
Nov 02 22:55:42 user nova-compute[74721]:   </devices>
Nov 02 22:55:42 user nova-compute[74721]: </domain>
Nov 02 22:55:42 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG os_vif [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f618c7e9-f9a9-5b1d-90ca-bd8341b2a0c4', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b517f6-e9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b517f6-e9, col_values=(('qos', UUID('36b3ef74-7c21-4478-8680-38b4c1475402')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b517f6-e9, col_values=(('external_ids', {'iface-id': 'd0b517f6-e930-4e60-8193-2aa28648ac45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ca:8f', 'vm-uuid': '80e598d8-a24f-412f-a083-3de7b0b853b3'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:43 user nova-compute[74721]: INFO os_vif [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 22:55:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No VIF found with MAC fa:16:3e:ce:ca:8f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Successfully updated port: 923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing instance network info cache due to event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updated VIF entry in instance network info cache for port d0b517f6-e930-4e60-8193-2aa28648ac45. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:55:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-427e8526-511a-4624-b64d-13a8895b94a8 req-dc307c5d-949b-458e-8116-f59dcac93ac5 service nova] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Instance network_info: |[{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.neutron [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Start _get_guest_xml network_info=[{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:55:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-762263899',display_name='tempest-ServerActionsTestOtherA-server-762263899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-762263899',id=4,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-r1hoc1az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=3f539868-3357-4719-a715-39ab06bf8898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:55:44 user nova-compute[74721]:   <uuid>3f539868-3357-4719-a715-39ab06bf8898</uuid>
Nov 02 22:55:44 user nova-compute[74721]:   <name>instance-00000004</name>
Nov 02 22:55:44 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:55:44 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:55:44 user nova-compute[74721]:   <metadata>
Nov 02 22:55:44 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:55:44 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherA-server-762263899</nova:name>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:55:44</nova:creationTime>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:55:44 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:55:44 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:owner>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:user uuid="2d3fb4cd21c349a1b60f075ffa63f393">tempest-ServerActionsTestOtherA-756381715-project-member</nova:user>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:project uuid="8d9ed314de1541b6854e6158ee0816a0">tempest-ServerActionsTestOtherA-756381715</nova:project>
Nov 02 22:55:44 user nova-compute[74721]:       </nova:owner>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:55:44 user nova-compute[74721]:       <nova:ports>
Nov 02 22:55:44 user nova-compute[74721]:         <nova:port uuid="923ab59f-9276-44a6-88c0-f7388ba29d12">
Nov 02 22:55:44 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 22:55:44 user nova-compute[74721]:         </nova:port>
Nov 02 22:55:44 user nova-compute[74721]:       </nova:ports>
Nov 02 22:55:44 user nova-compute[74721]:     </nova:instance>
Nov 02 22:55:44 user nova-compute[74721]:   </metadata>
Nov 02 22:55:44 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:55:44 user nova-compute[74721]:     <system>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="serial">3f539868-3357-4719-a715-39ab06bf8898</entry>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="uuid">3f539868-3357-4719-a715-39ab06bf8898</entry>
Nov 02 22:55:44 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:55:44 user nova-compute[74721]:     </system>
Nov 02 22:55:44 user nova-compute[74721]:   </sysinfo>
Nov 02 22:55:44 user nova-compute[74721]:   <os>
Nov 02 22:55:44 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:55:44 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:55:44 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:55:44 user nova-compute[74721]:   </os>
Nov 02 22:55:44 user nova-compute[74721]:   <features>
Nov 02 22:55:44 user nova-compute[74721]:     <acpi/>
Nov 02 22:55:44 user nova-compute[74721]:     <apic/>
Nov 02 22:55:44 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:55:44 user nova-compute[74721]:   </features>
Nov 02 22:55:44 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:55:44 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:55:44 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:55:44 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:55:44 user nova-compute[74721]:   </clock>
Nov 02 22:55:44 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:55:44 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:55:44 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:55:44 user nova-compute[74721]:   </cpu>
Nov 02 22:55:44 user nova-compute[74721]:   <devices>
Nov 02 22:55:44 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:55:44 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:55:44 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk"/>
Nov 02 22:55:44 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:55:44 user nova-compute[74721]:     </disk>
Nov 02 22:55:44 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:55:44 user nova-compute[74721]:       <mac address="fa:16:3e:b5:19:70"/>
Nov 02 22:55:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:44 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:55:44 user nova-compute[74721]:       <target dev="tap923ab59f-92"/>
Nov 02 22:55:44 user nova-compute[74721]:     </interface>
Nov 02 22:55:44 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:55:44 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/console.log" append="off"/>
Nov 02 22:55:44 user nova-compute[74721]:     </serial>
Nov 02 22:55:44 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:55:44 user nova-compute[74721]:     <video>
Nov 02 22:55:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:44 user nova-compute[74721]:     </video>
Nov 02 22:55:44 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:55:44 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:55:44 user nova-compute[74721]:     </rng>
Nov 02 22:55:44 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:55:44 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:55:44 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:55:44 user nova-compute[74721]:     </memballoon>
Nov 02 22:55:44 user nova-compute[74721]:   </devices>
Nov 02 22:55:44 user nova-compute[74721]: </domain>
Nov 02 22:55:44 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-762263899',display_name='tempest-ServerActionsTestOtherA-server-762263899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-762263899',id=4,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-r1hoc1az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=3f539868-3357-4719-a715-39ab06bf8898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG os_vif [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d56a9ba-a70b-56f6-9aa3-97ab5390b479', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap923ab59f-92, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap923ab59f-92, col_values=(('qos', UUID('bdf7919f-f205-4f5f-93f3-8b83a8d55a54')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap923ab59f-92, col_values=(('external_ids', {'iface-id': '923ab59f-9276-44a6-88c0-f7388ba29d12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:19:70', 'vm-uuid': '3f539868-3357-4719-a715-39ab06bf8898'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:44 user nova-compute[74721]: INFO os_vif [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92')
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:b5:19:70, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:55:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated VIF entry in instance network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-312861f5-9e30-41c1-93cd-26691fa46ce5 req-a6ee8021-8e48-483a-ab00-5a8b5be369ab service nova] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:55:49 user nova-compute[74721]: INFO nova.compute.claims [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Claim successful on node user
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:55:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:55:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance spawned successfully.
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.policy [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58614dc2b66e4f148f5caf8fa1e8f0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b0c73c0e50491b822af310ddfbd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:50 user nova-compute[74721]: INFO nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Took 15.57 seconds to spawn the instance on the hypervisor.
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:55:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Creating image(s)
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "/opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "/opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:50 user nova-compute[74721]: INFO nova.compute.manager [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Took 16.47 seconds to build instance.
Nov 02 22:55:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7682ce15-4059-4aab-9c54-c839bd90f87e tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.662s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance spawned successfully.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.300s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Took 17.87 seconds to spawn the instance on the hypervisor.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk 1073741824" returned: 0 in 0.084s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance spawned successfully.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.compute.manager [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Took 19.14 seconds to build instance.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-83e09f5a-9b1b-4d45-a47b-ee8c9560a6d8 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.374s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.295s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Instance spawned successfully.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:55:51 user nova-compute[74721]: INFO nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Took 15.40 seconds to spawn the instance on the hypervisor.
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Cannot resize image /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Ensure instance console log exists: /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:55:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:52 user nova-compute[74721]: INFO nova.compute.manager [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Took 16.32 seconds to build instance.
Nov 02 22:55:52 user nova-compute[74721]: INFO nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Took 13.60 seconds to spawn the instance on the hypervisor.
Nov 02 22:55:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:55:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f256005c-ba9f-491f-947d-9c74884f6a37 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.610s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:52 user nova-compute[74721]: INFO nova.compute.manager [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Took 14.55 seconds to build instance.
Nov 02 22:55:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6db2988e-b6c2-41ab-a6d1-93dee5b9b3e7 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.776s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:55:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Successfully created port: 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:55:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Successfully updated port: 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquired lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received event network-changed-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Refreshing instance network info cache due to event network-changed-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:55:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] Acquiring lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:55:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Releasing lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Instance network_info: |[{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] Acquired lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.neutron [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Refreshing network info cache for port 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Start _get_guest_xml network_info=[{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:55:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1399585792',display_name='tempest-VolumesAdminNegativeTest-server-1399585792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1399585792',id=5,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzzIlPQtoAZBYvHTTDuE7S7BqiGMfc+3NzfMqrNL+ltqsYQJFdQw2Wf8WuvGLFqcumy+QK1Pgf1f4LQfSK/SzgzoyMovyGhK32U2bnvwj1sGmepfGJ5Kl47w+caeJySWw==',key_name='tempest-keypair-1721132232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-2z7910bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=5e10c2d6-c1ca-4189-8833-bc40b17e19f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:55:57 user nova-compute[74721]:   <uuid>5e10c2d6-c1ca-4189-8833-bc40b17e19f5</uuid>
Nov 02 22:55:57 user nova-compute[74721]:   <name>instance-00000005</name>
Nov 02 22:55:57 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:55:57 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:55:57 user nova-compute[74721]:   <metadata>
Nov 02 22:55:57 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:55:57 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1399585792</nova:name>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:55:57</nova:creationTime>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:55:57 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:55:57 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:owner>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:user uuid="58614dc2b66e4f148f5caf8fa1e8f0d1">tempest-VolumesAdminNegativeTest-77842526-project-member</nova:user>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:project uuid="08b0c73c0e50491b822af310ddfbd64c">tempest-VolumesAdminNegativeTest-77842526</nova:project>
Nov 02 22:55:57 user nova-compute[74721]:       </nova:owner>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:55:57 user nova-compute[74721]:       <nova:ports>
Nov 02 22:55:57 user nova-compute[74721]:         <nova:port uuid="8faeef5f-f193-42ee-b8d9-5eb8aacbc02d">
Nov 02 22:55:57 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 22:55:57 user nova-compute[74721]:         </nova:port>
Nov 02 22:55:57 user nova-compute[74721]:       </nova:ports>
Nov 02 22:55:57 user nova-compute[74721]:     </nova:instance>
Nov 02 22:55:57 user nova-compute[74721]:   </metadata>
Nov 02 22:55:57 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:55:57 user nova-compute[74721]:     <system>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="serial">5e10c2d6-c1ca-4189-8833-bc40b17e19f5</entry>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="uuid">5e10c2d6-c1ca-4189-8833-bc40b17e19f5</entry>
Nov 02 22:55:57 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:55:57 user nova-compute[74721]:     </system>
Nov 02 22:55:57 user nova-compute[74721]:   </sysinfo>
Nov 02 22:55:57 user nova-compute[74721]:   <os>
Nov 02 22:55:57 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:55:57 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:55:57 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:55:57 user nova-compute[74721]:   </os>
Nov 02 22:55:57 user nova-compute[74721]:   <features>
Nov 02 22:55:57 user nova-compute[74721]:     <acpi/>
Nov 02 22:55:57 user nova-compute[74721]:     <apic/>
Nov 02 22:55:57 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:55:57 user nova-compute[74721]:   </features>
Nov 02 22:55:57 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:55:57 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:55:57 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:55:57 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:55:57 user nova-compute[74721]:   </clock>
Nov 02 22:55:57 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:55:57 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:55:57 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:55:57 user nova-compute[74721]:   </cpu>
Nov 02 22:55:57 user nova-compute[74721]:   <devices>
Nov 02 22:55:57 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:55:57 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:55:57 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk"/>
Nov 02 22:55:57 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:55:57 user nova-compute[74721]:     </disk>
Nov 02 22:55:57 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:55:57 user nova-compute[74721]:       <mac address="fa:16:3e:bd:e3:6f"/>
Nov 02 22:55:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:57 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:55:57 user nova-compute[74721]:       <target dev="tap8faeef5f-f1"/>
Nov 02 22:55:57 user nova-compute[74721]:     </interface>
Nov 02 22:55:57 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:55:57 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/console.log" append="off"/>
Nov 02 22:55:57 user nova-compute[74721]:     </serial>
Nov 02 22:55:57 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:55:57 user nova-compute[74721]:     <video>
Nov 02 22:55:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:55:57 user nova-compute[74721]:     </video>
Nov 02 22:55:57 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:55:57 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:55:57 user nova-compute[74721]:     </rng>
Nov 02 22:55:57 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:55:57 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:55:57 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:55:57 user nova-compute[74721]:     </memballoon>
Nov 02 22:55:57 user nova-compute[74721]:   </devices>
Nov 02 22:55:57 user nova-compute[74721]: </domain>
Nov 02 22:55:57 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1399585792',display_name='tempest-VolumesAdminNegativeTest-server-1399585792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1399585792',id=5,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzzIlPQtoAZBYvHTTDuE7S7BqiGMfc+3NzfMqrNL+ltqsYQJFdQw2Wf8WuvGLFqcumy+QK1Pgf1f4LQfSK/SzgzoyMovyGhK32U2bnvwj1sGmepfGJ5Kl47w+caeJySWw==',key_name='tempest-keypair-1721132232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-2z7910bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=5e10c2d6-c1ca-4189-8833-bc40b17e19f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG os_vif [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a107035b-7828-5c88-8050-67d8e4ec5dc4', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8faeef5f-f1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8faeef5f-f1, col_values=(('qos', UUID('1ed022c2-02e1-425f-a8c6-345cbeeb0ee4')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8faeef5f-f1, col_values=(('external_ids', {'iface-id': '8faeef5f-f193-42ee-b8d9-5eb8aacbc02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:e3:6f', 'vm-uuid': '5e10c2d6-c1ca-4189-8833-bc40b17e19f5'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:57 user nova-compute[74721]: INFO os_vif [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1')
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:55:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No VIF found with MAC fa:16:3e:bd:e3:6f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:55:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updated VIF entry in instance network info cache for port 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a90e25b0-42ba-4e63-af95-71748d2e263e req-f8ff14e2-697e-4c99-a0f3-ea66415a5c1d service nova] Releasing lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:55:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:00 user nova-compute[74721]: WARNING nova.compute.manager [req-2881b21d-7fea-450b-813a-43d19e159a5b req-07ca9ed0-2901-4dee-9823-18d5cc8e1833 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state None.
Nov 02 22:56:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:01 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:56:01 user nova-compute[74721]: INFO nova.compute.claims [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Claim successful on node user
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:02 user nova-compute[74721]: WARNING nova.compute.manager [req-a8f424fa-58cb-4b2d-b130-8145876be592 req-f8e0dbbc-b38e-49de-8e07-291dbe64ca05 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state None.
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:56:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.policy [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77b637ca53764e28b8c17734c925a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e51a8371104288865539548619d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:56:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Creating image(s)
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:56:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Instance spawned successfully.
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Successfully created port: 4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:56:03 user nova-compute[74721]: INFO nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Took 12.78 seconds to spawn the instance on the hypervisor.
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.part --force-share --output=json" returned: 0 in 0.338s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.virt.images [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] 9fe4b63e-93b1-4bd3-836f-1dd602c283f7 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.part /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:03 user nova-compute[74721]: INFO nova.compute.manager [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Took 14.19 seconds to build instance.
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0cc4b123-d920-4b78-8cbb-49ceee7c07e2 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.366s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.part /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.converted" returned: 0 in 0.280s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073.converted --force-share --output=json" returned: 0 in 0.321s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.449s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json" returned: 0 in 0.255s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Successfully updated port: 4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquired lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-changed-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Refreshing instance network info cache due to event network-changed-4855034d-41d3-464b-b24c-f0c865ae6f41. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] Acquiring lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json" returned: 0 in 0.316s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073,backing_fmt=raw /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073,backing_fmt=raw /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk 1073741824" returned: 0 in 0.065s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "6d51a1f7c03cc731d742a96dbea7bfa62f9f0073" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073 --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating instance_info_cache with network_info: [{"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Releasing lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Instance network_info: |[{"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] Acquired lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Refreshing network info cache for port 4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Cannot resize image /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Ensure instance console log exists: /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Start _get_guest_xml network_info=[{"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:55:48Z,direct_url=<?>,disk_format='qcow2',id=9fe4b63e-93b1-4bd3-836f-1dd602c283f7,min_disk=0,min_ram=0,name='',owner='52735c6cd7b34bf29ed774ed6cb46cbd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:55:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': '9fe4b63e-93b1-4bd3-836f-1dd602c283f7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:56:05 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:05 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:55:48Z,direct_url=<?>,disk_format='qcow2',id=9fe4b63e-93b1-4bd3-836f-1dd602c283f7,min_disk=0,min_ram=0,name='',owner='52735c6cd7b34bf29ed774ed6cb46cbd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:55:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1808402758',display_name='tempest-AttachSCSIVolumeTestJSON-server-1808402758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1808402758',id=6,image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+HOOcPQmZQORve+E4+3EsUctoyhUV0QGQ6gZKe+RTjDY9UHEJobPozplF+WcmEA6dxeWb2IBAdc3tWZuLAUwXP+PjFATZmlssD9mWqCMpT+j2qy3xo5qS1ngsBfpvow==',key_name='tempest-keypair-619731102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e51a8371104288865539548619d4e4',ramdisk_id='',reservation_id='r-33ziejmv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1925784694',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1925784694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77b637ca53764e28b8c17734c925a0c2',uuid=57e7fd79-796c-4531-bedd-969b531c343f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converting VIF {"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.objects.instance [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lazy-loading 'pci_devices' on Instance uuid 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:56:05 user nova-compute[74721]:   <uuid>57e7fd79-796c-4531-bedd-969b531c343f</uuid>
Nov 02 22:56:05 user nova-compute[74721]:   <name>instance-00000006</name>
Nov 02 22:56:05 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:56:05 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:56:05 user nova-compute[74721]:   <metadata>
Nov 02 22:56:05 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:56:05 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1808402758</nova:name>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:56:05</nova:creationTime>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:56:05 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:56:05 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:owner>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:user uuid="77b637ca53764e28b8c17734c925a0c2">tempest-AttachSCSIVolumeTestJSON-1925784694-project-member</nova:user>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:project uuid="c0e51a8371104288865539548619d4e4">tempest-AttachSCSIVolumeTestJSON-1925784694</nova:project>
Nov 02 22:56:05 user nova-compute[74721]:       </nova:owner>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:root type="image" uuid="9fe4b63e-93b1-4bd3-836f-1dd602c283f7"/>
Nov 02 22:56:05 user nova-compute[74721]:       <nova:ports>
Nov 02 22:56:05 user nova-compute[74721]:         <nova:port uuid="4855034d-41d3-464b-b24c-f0c865ae6f41">
Nov 02 22:56:05 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 22:56:05 user nova-compute[74721]:         </nova:port>
Nov 02 22:56:05 user nova-compute[74721]:       </nova:ports>
Nov 02 22:56:05 user nova-compute[74721]:     </nova:instance>
Nov 02 22:56:05 user nova-compute[74721]:   </metadata>
Nov 02 22:56:05 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:56:05 user nova-compute[74721]:     <system>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="serial">57e7fd79-796c-4531-bedd-969b531c343f</entry>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="uuid">57e7fd79-796c-4531-bedd-969b531c343f</entry>
Nov 02 22:56:05 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:56:05 user nova-compute[74721]:     </system>
Nov 02 22:56:05 user nova-compute[74721]:   </sysinfo>
Nov 02 22:56:05 user nova-compute[74721]:   <os>
Nov 02 22:56:05 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:56:05 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:56:05 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:56:05 user nova-compute[74721]:   </os>
Nov 02 22:56:05 user nova-compute[74721]:   <features>
Nov 02 22:56:05 user nova-compute[74721]:     <acpi/>
Nov 02 22:56:05 user nova-compute[74721]:     <apic/>
Nov 02 22:56:05 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:56:05 user nova-compute[74721]:   </features>
Nov 02 22:56:05 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:56:05 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:56:05 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:56:05 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:56:05 user nova-compute[74721]:   </clock>
Nov 02 22:56:05 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:56:05 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:56:05 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:56:05 user nova-compute[74721]:   </cpu>
Nov 02 22:56:05 user nova-compute[74721]:   <devices>
Nov 02 22:56:05 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:56:05 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:56:05 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk"/>
Nov 02 22:56:05 user nova-compute[74721]:       <target dev="sda" bus="scsi"/>
Nov 02 22:56:05 user nova-compute[74721]:       <address type="drive" controller="0" unit="0"/>
Nov 02 22:56:05 user nova-compute[74721]:     </disk>
Nov 02 22:56:05 user nova-compute[74721]:     <disk type="file" device="cdrom">
Nov 02 22:56:05 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 22:56:05 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.config"/>
Nov 02 22:56:05 user nova-compute[74721]:       <target dev="sdb" bus="scsi"/>
Nov 02 22:56:05 user nova-compute[74721]:       <address type="drive" controller="0" unit="1"/>
Nov 02 22:56:05 user nova-compute[74721]:     </disk>
Nov 02 22:56:05 user nova-compute[74721]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 02 22:56:05 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:56:05 user nova-compute[74721]:       <mac address="fa:16:3e:f0:da:c1"/>
Nov 02 22:56:05 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:05 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:56:05 user nova-compute[74721]:       <target dev="tap4855034d-41"/>
Nov 02 22:56:05 user nova-compute[74721]:     </interface>
Nov 02 22:56:05 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:56:05 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/console.log" append="off"/>
Nov 02 22:56:05 user nova-compute[74721]:     </serial>
Nov 02 22:56:05 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:56:05 user nova-compute[74721]:     <video>
Nov 02 22:56:05 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:05 user nova-compute[74721]:     </video>
Nov 02 22:56:05 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:56:05 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:56:05 user nova-compute[74721]:     </rng>
Nov 02 22:56:05 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:56:05 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:56:05 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:56:05 user nova-compute[74721]:     </memballoon>
Nov 02 22:56:05 user nova-compute[74721]:   </devices>
Nov 02 22:56:05 user nova-compute[74721]: </domain>
Nov 02 22:56:05 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1808402758',display_name='tempest-AttachSCSIVolumeTestJSON-server-1808402758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1808402758',id=6,image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+HOOcPQmZQORve+E4+3EsUctoyhUV0QGQ6gZKe+RTjDY9UHEJobPozplF+WcmEA6dxeWb2IBAdc3tWZuLAUwXP+PjFATZmlssD9mWqCMpT+j2qy3xo5qS1ngsBfpvow==',key_name='tempest-keypair-619731102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e51a8371104288865539548619d4e4',ramdisk_id='',reservation_id='r-33ziejmv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1925784694',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1925784694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77b637ca53764e28b8c17734c925a0c2',uuid=57e7fd79-796c-4531-bedd-969b531c343f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converting VIF {"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG os_vif [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12b38cfb-dd1d-573b-82f1-598252931011', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4855034d-41, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4855034d-41, col_values=(('qos', UUID('41bd773b-8664-4656-ab45-65b826d47abf')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4855034d-41, col_values=(('external_ids', {'iface-id': '4855034d-41d3-464b-b24c-f0c865ae6f41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:da:c1', 'vm-uuid': '57e7fd79-796c-4531-bedd-969b531c343f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:05 user nova-compute[74721]: INFO os_vif [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41')
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No BDM found with device name sda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No VIF found with MAC fa:16:3e:f0:da:c1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:56:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Using config drive
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updated VIF entry in instance network info cache for port 4855034d-41d3-464b-b24c-f0c865ae6f41. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating instance_info_cache with network_info: [{"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5c1bf5c3-333b-4488-a18b-ae402ca4d6b3 req-8eb61850-cb6e-4bee-8489-944fc4bb3fc8 service nova] Releasing lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Creating config drive at /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.config
Nov 02 22:56:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp206hbglw {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp206hbglw" returned: 0 in 0.071s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:06 user nova-compute[74721]: WARNING nova.compute.manager [req-325524a0-2810-4889-be3b-8650d5e018b4 req-f8ff0a35-82d9-46e7-8bb3-d9c0ae925efa service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state None.
Nov 02 22:56:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:08 user nova-compute[74721]: WARNING nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state None.
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] No waiting events found dispatching network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:08 user nova-compute[74721]: WARNING nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received unexpected event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 for instance with vm_state active and task_state None.
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] No waiting events found dispatching network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:08 user nova-compute[74721]: WARNING nova.compute.manager [req-c073d9b1-8f26-4972-a1f3-1814f87a4ffc req-f20dcfb0-d7e3-48d8-93d2-0ffe46bba41f service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received unexpected event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 for instance with vm_state active and task_state None.
Nov 02 22:56:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:09 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:56:09 user nova-compute[74721]: INFO nova.compute.claims [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Claim successful on node user
Nov 02 22:56:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.832s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:56:10 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.policy [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6eca999eda14ff3922db1af2088e121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ce82279ae74e80b7b31c5465b2e8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:56:10 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Creating image(s)
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "/opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "/opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "/opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.091s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk 1073741824" returned: 0 in 0.087s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:56:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Instance spawned successfully.
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:11 user nova-compute[74721]: INFO nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Took 8.60 seconds to spawn the instance on the hypervisor.
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:56:11 user nova-compute[74721]: INFO nova.compute.claims [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Claim successful on node user
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Successfully created port: 8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:11 user nova-compute[74721]: INFO nova.compute.manager [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Took 9.93 seconds to build instance.
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-915ffb8d-ed7c-449c-97ed-867947566a57 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.107s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Cannot resize image /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Ensure instance console log exists: /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.205s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:56:11 user nova-compute[74721]: INFO nova.compute.claims [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Claim successful on node user
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:56:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:56:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Creating image(s)
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.policy [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1143bb233a7247e5bde80acd173b10a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b3e882b89446fbae7d5b65f973bf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Successfully updated port: 8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquired lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-changed-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Refreshing instance network info cache due to event network-changed-8435099b-ed0e-41cc-a0cb-15abc14df2ce. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] Acquiring lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk 1073741824" returned: 0 in 0.073s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:56:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.policy [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '616c3bf4067e40e7819a7c03d10f8387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5450d4754cb14909b47768445b98695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.240s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:56:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:56:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Creating image(s)
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "/opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "/opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received event network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] No waiting events found dispatching network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:13 user nova-compute[74721]: WARNING nova.compute.manager [req-31210d77-a86e-49ac-bf95-e2d5ab32bc1b req-2b9fa3e6-acc5-4f16-90ce-35ba5a31b1eb service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received unexpected event network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d for instance with vm_state active and task_state None.
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Cannot resize image /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Ensure instance console log exists: /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updating instance_info_cache with network_info: [{"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Releasing lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Instance network_info: |[{"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] Acquired lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Refreshing network info cache for port 8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Start _get_guest_xml network_info=[{"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:56:13 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:13 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2020667730',display_name='tempest-TestVolumeSwap-server-2020667730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2020667730',id=7,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAGa/HA4KhaouNBJOgNO/LqkXF9qeey5r8jevzbsvRDZxaG7+yQc3qE6ZJM5HJrJ+Kv7kPILs9EetFn1Dzoanl/lobQ2Kqa8242wefPtDEwzl39Pn/Wou5bxNm50R13yw==',key_name='tempest-keypair-1198555046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ce82279ae74e80b7b31c5465b2e8fc',ramdisk_id='',reservation_id='r-ff9wj67i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1130811799',owner_user_name='tempest-TestVolumeSwap-1130811799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6eca999eda14ff3922db1af2088e121',uuid=102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converting VIF {"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lazy-loading 'pci_devices' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:56:13 user nova-compute[74721]:   <uuid>102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc</uuid>
Nov 02 22:56:13 user nova-compute[74721]:   <name>instance-00000007</name>
Nov 02 22:56:13 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:56:13 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:56:13 user nova-compute[74721]:   <metadata>
Nov 02 22:56:13 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:56:13 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:name>tempest-TestVolumeSwap-server-2020667730</nova:name>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:56:13</nova:creationTime>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:56:13 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:56:13 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:owner>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:user uuid="f6eca999eda14ff3922db1af2088e121">tempest-TestVolumeSwap-1130811799-project-member</nova:user>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:project uuid="a3ce82279ae74e80b7b31c5465b2e8fc">tempest-TestVolumeSwap-1130811799</nova:project>
Nov 02 22:56:13 user nova-compute[74721]:       </nova:owner>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:56:13 user nova-compute[74721]:       <nova:ports>
Nov 02 22:56:13 user nova-compute[74721]:         <nova:port uuid="8435099b-ed0e-41cc-a0cb-15abc14df2ce">
Nov 02 22:56:13 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 22:56:13 user nova-compute[74721]:         </nova:port>
Nov 02 22:56:13 user nova-compute[74721]:       </nova:ports>
Nov 02 22:56:13 user nova-compute[74721]:     </nova:instance>
Nov 02 22:56:13 user nova-compute[74721]:   </metadata>
Nov 02 22:56:13 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:56:13 user nova-compute[74721]:     <system>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="serial">102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc</entry>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="uuid">102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc</entry>
Nov 02 22:56:13 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:56:13 user nova-compute[74721]:     </system>
Nov 02 22:56:13 user nova-compute[74721]:   </sysinfo>
Nov 02 22:56:13 user nova-compute[74721]:   <os>
Nov 02 22:56:13 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:56:13 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:56:13 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:56:13 user nova-compute[74721]:   </os>
Nov 02 22:56:13 user nova-compute[74721]:   <features>
Nov 02 22:56:13 user nova-compute[74721]:     <acpi/>
Nov 02 22:56:13 user nova-compute[74721]:     <apic/>
Nov 02 22:56:13 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:56:13 user nova-compute[74721]:   </features>
Nov 02 22:56:13 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:56:13 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:56:13 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:56:13 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:56:13 user nova-compute[74721]:   </clock>
Nov 02 22:56:13 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:56:13 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:56:13 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:56:13 user nova-compute[74721]:   </cpu>
Nov 02 22:56:13 user nova-compute[74721]:   <devices>
Nov 02 22:56:13 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:56:13 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:56:13 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk"/>
Nov 02 22:56:13 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:56:13 user nova-compute[74721]:     </disk>
Nov 02 22:56:13 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:56:13 user nova-compute[74721]:       <mac address="fa:16:3e:0c:f1:3a"/>
Nov 02 22:56:13 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:13 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:56:13 user nova-compute[74721]:       <target dev="tap8435099b-ed"/>
Nov 02 22:56:13 user nova-compute[74721]:     </interface>
Nov 02 22:56:13 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:56:13 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/console.log" append="off"/>
Nov 02 22:56:13 user nova-compute[74721]:     </serial>
Nov 02 22:56:13 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:56:13 user nova-compute[74721]:     <video>
Nov 02 22:56:13 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:13 user nova-compute[74721]:     </video>
Nov 02 22:56:13 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:56:13 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:56:13 user nova-compute[74721]:     </rng>
Nov 02 22:56:13 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:56:13 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:56:13 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:56:13 user nova-compute[74721]:     </memballoon>
Nov 02 22:56:13 user nova-compute[74721]:   </devices>
Nov 02 22:56:13 user nova-compute[74721]: </domain>
Nov 02 22:56:13 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2020667730',display_name='tempest-TestVolumeSwap-server-2020667730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2020667730',id=7,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAGa/HA4KhaouNBJOgNO/LqkXF9qeey5r8jevzbsvRDZxaG7+yQc3qE6ZJM5HJrJ+Kv7kPILs9EetFn1Dzoanl/lobQ2Kqa8242wefPtDEwzl39Pn/Wou5bxNm50R13yw==',key_name='tempest-keypair-1198555046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ce82279ae74e80b7b31c5465b2e8fc',ramdisk_id='',reservation_id='r-ff9wj67i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1130811799',owner_user_name='tempest-TestVolumeSwap-1130811799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6eca999eda14ff3922db1af2088e121',uuid=102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converting VIF {"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG os_vif [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82bea62a-b323-5109-a118-6aa45c36b891', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8435099b-ed, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8435099b-ed, col_values=(('qos', UUID('9ed0490a-f787-43cf-b415-453fc1043896')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8435099b-ed, col_values=(('external_ids', {'iface-id': '8435099b-ed0e-41cc-a0cb-15abc14df2ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:f1:3a', 'vm-uuid': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:13 user nova-compute[74721]: INFO os_vif [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed')
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.254s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Successfully created port: daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk 1073741824" returned: 0 in 0.083s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Successfully created port: 05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] No VIF found with MAC fa:16:3e:0c:f1:3a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Cannot resize image /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Ensure instance console log exists: /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updated VIF entry in instance network info cache for port 8435099b-ed0e-41cc-a0cb-15abc14df2ce. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updating instance_info_cache with network_info: [{"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52cff4d7-1c36-4b63-93c6-a7c78b2d8e0e req-8d2e8b82-4f54-4e54-820e-606b8cae12d9 service nova] Releasing lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Successfully updated port: 05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquired lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-changed-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Refreshing instance network info cache due to event network-changed-05c8c59a-f285-4876-9c9b-9d86a1a0137c. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] Acquiring lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating instance_info_cache with network_info: [{"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Releasing lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Instance network_info: |[{"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] Acquired lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Refreshing network info cache for port 05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Start _get_guest_xml network_info=[{"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:56:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1385668588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1385668588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1385668588',id=9,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElKbxp2KdhJtAfrLjhmYAxai8NPlv7ZzgM/r9anYfJkpEyTv7sljGi8uepWz0jt06q/kLnGIWN6QaxG1LkYo20PvnOfLaOTTQcwYXPSVrQK98wCIxnOWywXjS92QWVA5A==',key_name='tempest-keypair-1424932714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5450d4754cb14909b47768445b98695d',ramdisk_id='',reservation_id='r-o9bthxnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-476708363',owner_user_name='tempest-VolumesAssistedSnapshotsTest-476708363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616c3bf4067e40e7819a7c03d10f8387',uuid=5fa6ebee-92d1-47f6-97ec-526d5de9b2a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converting VIF {"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Successfully updated port: daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:56:14 user nova-compute[74721]:   <uuid>5fa6ebee-92d1-47f6-97ec-526d5de9b2a7</uuid>
Nov 02 22:56:14 user nova-compute[74721]:   <name>instance-00000009</name>
Nov 02 22:56:14 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:56:14 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:56:14 user nova-compute[74721]:   <metadata>
Nov 02 22:56:14 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:56:14 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1385668588</nova:name>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:56:14</nova:creationTime>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:56:14 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:56:14 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:owner>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:user uuid="616c3bf4067e40e7819a7c03d10f8387">tempest-VolumesAssistedSnapshotsTest-476708363-project-member</nova:user>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:project uuid="5450d4754cb14909b47768445b98695d">tempest-VolumesAssistedSnapshotsTest-476708363</nova:project>
Nov 02 22:56:14 user nova-compute[74721]:       </nova:owner>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:56:14 user nova-compute[74721]:       <nova:ports>
Nov 02 22:56:14 user nova-compute[74721]:         <nova:port uuid="05c8c59a-f285-4876-9c9b-9d86a1a0137c">
Nov 02 22:56:14 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 22:56:14 user nova-compute[74721]:         </nova:port>
Nov 02 22:56:14 user nova-compute[74721]:       </nova:ports>
Nov 02 22:56:14 user nova-compute[74721]:     </nova:instance>
Nov 02 22:56:14 user nova-compute[74721]:   </metadata>
Nov 02 22:56:14 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:56:14 user nova-compute[74721]:     <system>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="serial">5fa6ebee-92d1-47f6-97ec-526d5de9b2a7</entry>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="uuid">5fa6ebee-92d1-47f6-97ec-526d5de9b2a7</entry>
Nov 02 22:56:14 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:56:14 user nova-compute[74721]:     </system>
Nov 02 22:56:14 user nova-compute[74721]:   </sysinfo>
Nov 02 22:56:14 user nova-compute[74721]:   <os>
Nov 02 22:56:14 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:56:14 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:56:14 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:56:14 user nova-compute[74721]:   </os>
Nov 02 22:56:14 user nova-compute[74721]:   <features>
Nov 02 22:56:14 user nova-compute[74721]:     <acpi/>
Nov 02 22:56:14 user nova-compute[74721]:     <apic/>
Nov 02 22:56:14 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:56:14 user nova-compute[74721]:   </features>
Nov 02 22:56:14 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:56:14 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:56:14 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:56:14 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:56:14 user nova-compute[74721]:   </clock>
Nov 02 22:56:14 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:56:14 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:56:14 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:56:14 user nova-compute[74721]:   </cpu>
Nov 02 22:56:14 user nova-compute[74721]:   <devices>
Nov 02 22:56:14 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:56:14 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:56:14 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk"/>
Nov 02 22:56:14 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:56:14 user nova-compute[74721]:     </disk>
Nov 02 22:56:14 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:56:14 user nova-compute[74721]:       <mac address="fa:16:3e:53:4e:f8"/>
Nov 02 22:56:14 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:14 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:56:14 user nova-compute[74721]:       <target dev="tap05c8c59a-f2"/>
Nov 02 22:56:14 user nova-compute[74721]:     </interface>
Nov 02 22:56:14 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:56:14 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/console.log" append="off"/>
Nov 02 22:56:14 user nova-compute[74721]:     </serial>
Nov 02 22:56:14 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:56:14 user nova-compute[74721]:     <video>
Nov 02 22:56:14 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:14 user nova-compute[74721]:     </video>
Nov 02 22:56:14 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:56:14 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:56:14 user nova-compute[74721]:     </rng>
Nov 02 22:56:14 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:56:14 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:56:14 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:56:14 user nova-compute[74721]:     </memballoon>
Nov 02 22:56:14 user nova-compute[74721]:   </devices>
Nov 02 22:56:14 user nova-compute[74721]: </domain>
Nov 02 22:56:14 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1385668588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1385668588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1385668588',id=9,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElKbxp2KdhJtAfrLjhmYAxai8NPlv7ZzgM/r9anYfJkpEyTv7sljGi8uepWz0jt06q/kLnGIWN6QaxG1LkYo20PvnOfLaOTTQcwYXPSVrQK98wCIxnOWywXjS92QWVA5A==',key_name='tempest-keypair-1424932714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5450d4754cb14909b47768445b98695d',ramdisk_id='',reservation_id='r-o9bthxnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-476708363',owner_user_name='tempest-VolumesAssistedSnapshotsTest-476708363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616c3bf4067e40e7819a7c03d10f8387',uuid=5fa6ebee-92d1-47f6-97ec-526d5de9b2a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converting VIF {"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG os_vif [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-changed-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing instance network info cache due to event network-changed-daef9cf0-de2c-4719-84a6-f5999eaa9204. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b0b232b-3ae5-5ad9-b3f8-b19747b40f1b', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05c8c59a-f2, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05c8c59a-f2, col_values=(('qos', UUID('5266fcc2-0742-4d62-ad46-1d78e0165ec6')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05c8c59a-f2, col_values=(('external_ids', {'iface-id': '05c8c59a-f285-4876-9c9b-9d86a1a0137c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:4e:f8', 'vm-uuid': '5fa6ebee-92d1-47f6-97ec-526d5de9b2a7'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:14 user nova-compute[74721]: INFO os_vif [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2')
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] No VIF found with MAC fa:16:3e:53:4e:f8, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updated VIF entry in instance network info cache for port 05c8c59a-f285-4876-9c9b-9d86a1a0137c. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating instance_info_cache with network_info: [{"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370cd7a-37af-4358-bd1a-1ff7844352cf req-1fb5ba2c-0de5-40a1-b432-ba8a02e086bc service nova] Releasing lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Instance network_info: |[{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing network info cache for port daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Start _get_guest_xml network_info=[{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:56:15 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:15 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'pci_devices' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:56:15 user nova-compute[74721]:   <uuid>65971139-4ea2-4c05-b4ec-beb6e91bb571</uuid>
Nov 02 22:56:15 user nova-compute[74721]:   <name>instance-00000008</name>
Nov 02 22:56:15 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:56:15 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:56:15 user nova-compute[74721]:   <metadata>
Nov 02 22:56:15 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:56:15 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:56:15</nova:creationTime>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:56:15 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:56:15 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:owner>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 22:56:15 user nova-compute[74721]:       </nova:owner>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:56:15 user nova-compute[74721]:       <nova:ports>
Nov 02 22:56:15 user nova-compute[74721]:         <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 22:56:15 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 22:56:15 user nova-compute[74721]:         </nova:port>
Nov 02 22:56:15 user nova-compute[74721]:       </nova:ports>
Nov 02 22:56:15 user nova-compute[74721]:     </nova:instance>
Nov 02 22:56:15 user nova-compute[74721]:   </metadata>
Nov 02 22:56:15 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:56:15 user nova-compute[74721]:     <system>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="serial">65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="uuid">65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 22:56:15 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:56:15 user nova-compute[74721]:     </system>
Nov 02 22:56:15 user nova-compute[74721]:   </sysinfo>
Nov 02 22:56:15 user nova-compute[74721]:   <os>
Nov 02 22:56:15 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:56:15 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:56:15 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:56:15 user nova-compute[74721]:   </os>
Nov 02 22:56:15 user nova-compute[74721]:   <features>
Nov 02 22:56:15 user nova-compute[74721]:     <acpi/>
Nov 02 22:56:15 user nova-compute[74721]:     <apic/>
Nov 02 22:56:15 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:56:15 user nova-compute[74721]:   </features>
Nov 02 22:56:15 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:56:15 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:56:15 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:56:15 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:56:15 user nova-compute[74721]:   </clock>
Nov 02 22:56:15 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:56:15 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:56:15 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:56:15 user nova-compute[74721]:   </cpu>
Nov 02 22:56:15 user nova-compute[74721]:   <devices>
Nov 02 22:56:15 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:56:15 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:56:15 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk"/>
Nov 02 22:56:15 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:56:15 user nova-compute[74721]:     </disk>
Nov 02 22:56:15 user nova-compute[74721]:     <disk type="file" device="cdrom">
Nov 02 22:56:15 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 22:56:15 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config"/>
Nov 02 22:56:15 user nova-compute[74721]:       <target dev="hda" bus="ide"/>
Nov 02 22:56:15 user nova-compute[74721]:     </disk>
Nov 02 22:56:15 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:56:15 user nova-compute[74721]:       <mac address="fa:16:3e:80:bf:49"/>
Nov 02 22:56:15 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:15 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:56:15 user nova-compute[74721]:       <target dev="tapdaef9cf0-de"/>
Nov 02 22:56:15 user nova-compute[74721]:     </interface>
Nov 02 22:56:15 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:56:15 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log" append="off"/>
Nov 02 22:56:15 user nova-compute[74721]:     </serial>
Nov 02 22:56:15 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:56:15 user nova-compute[74721]:     <video>
Nov 02 22:56:15 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:56:15 user nova-compute[74721]:     </video>
Nov 02 22:56:15 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:56:15 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:56:15 user nova-compute[74721]:     </rng>
Nov 02 22:56:15 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:56:15 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:56:15 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:56:15 user nova-compute[74721]:     </memballoon>
Nov 02 22:56:15 user nova-compute[74721]:   </devices>
Nov 02 22:56:15 user nova-compute[74721]: </domain>
Nov 02 22:56:15 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:56:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG os_vif [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd518a611-9b72-5e44-a224-38a7cad30f76', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaef9cf0-de, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaef9cf0-de, col_values=(('qos', UUID('eef94a6b-4aba-4b57-9701-a75e86fb0396')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaef9cf0-de, col_values=(('external_ids', {'iface-id': 'daef9cf0-de2c-4719-84a6-f5999eaa9204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:bf:49', 'vm-uuid': '65971139-4ea2-4c05-b4ec-beb6e91bb571'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: INFO os_vif [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de')
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received event network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] No waiting events found dispatching network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:15 user nova-compute[74721]: WARNING nova.compute.manager [req-0ce66c40-7d70-40bb-9486-8829f5f872af req-8869e040-e84c-4181-96d6-806f9d35909e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received unexpected event network-vif-plugged-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d for instance with vm_state active and task_state None.
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name hda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No VIF found with MAC fa:16:3e:80:bf:49, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:56:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Using config drive
Nov 02 22:56:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Creating config drive at /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7l530l04 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7l530l04" returned: 0 in 0.060s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updated VIF entry in instance network info cache for port daef9cf0-de2c-4719-84a6-f5999eaa9204. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c57c994-ebfd-4697-a6f7-efec6463d4f3 req-22ad1e44-c357-4a52-9bb4-aa2e008f1189 service nova] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] No waiting events found dispatching network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:18 user nova-compute[74721]: WARNING nova.compute.manager [req-84202c82-996c-4024-ab5e-3017ca7d741d req-b40199ad-ea57-4e2b-8235-311d56d76c5f service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received unexpected event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c for instance with vm_state building and task_state spawning.
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 22:56:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:56:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:20 user nova-compute[74721]: WARNING nova.compute.manager [req-91c74202-2217-464f-81a4-7e12c7dc1f83 req-8b39eb8c-7808-489b-92cd-84b4d6bf607f service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state None.
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] No waiting events found dispatching network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:20 user nova-compute[74721]: WARNING nova.compute.manager [req-c60941a8-18cb-45b0-90c6-3355d6998e25 req-4cdd1a76-d40f-496a-a623-3ac4759d3ae0 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received unexpected event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c for instance with vm_state building and task_state spawning.
Nov 02 22:56:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:56:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Instance spawned successfully.
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:20 user nova-compute[74721]: INFO nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Took 10.41 seconds to spawn the instance on the hypervisor.
Nov 02 22:56:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Instance spawned successfully.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Instance spawned successfully.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.compute.manager [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Took 11.80 seconds to build instance.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7c223bb5-4ae5-4aea-84cd-48b9dbaef59d tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.108s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Took 9.13 seconds to spawn the instance on the hypervisor.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.compute.manager [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Took 10.11 seconds to build instance.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ae7e20f1-1bad-46fa-9b18-09b8e9c91d0d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.279s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:21 user nova-compute[74721]: INFO nova.compute.manager [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Took 9.87 seconds to build instance.
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fc9a20b9-1fd7-41ed-bd61-283ab923cafa tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.020s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:22 user nova-compute[74721]: WARNING nova.compute.manager [req-91a6dfa2-dafc-4a3f-9cb9-14aaac18a86d req-92f1a00b-ab54-467e-a846-d1ff5dd372d5 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state None.
Nov 02 22:56:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:23 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:56:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:56:29 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:29 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=25.682479858398438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 57e7fd79-796c-4531-bedd-969b531c343f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 22:56:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:56:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.037s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:56:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:33 user nova-compute[74721]: WARNING nova.compute.manager [req-46addc95-5fac-491c-9175-d572bb97a0a7 req-9aa4388b-3310-4386-a54f-e06208b44c92 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state active and task_state None.
Nov 02 22:56:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:35 user nova-compute[74721]: WARNING nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state active and task_state None.
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] No waiting events found dispatching network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:35 user nova-compute[74721]: WARNING nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received unexpected event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce for instance with vm_state active and task_state None.
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] No waiting events found dispatching network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:35 user nova-compute[74721]: WARNING nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received unexpected event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce for instance with vm_state active and task_state None.
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:35 user nova-compute[74721]: WARNING nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 for instance with vm_state active and task_state None.
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:56:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:56:35 user nova-compute[74721]: WARNING nova.compute.manager [req-ff1bf2d0-6880-41f0-8258-c89e7611cf54 req-416b26b1-3a58-4fff-af09-c14701f9086d service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 for instance with vm_state active and task_state None.
Nov 02 22:56:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:56:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:57:22 user nova-compute[74721]: INFO nova.compute.claims [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Claim successful on node user
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:57:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:57:22 user nova-compute[74721]: INFO nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Booting with volume b588f0ac-6217-4a4b-8c20-ad426082ed54 at /dev/vda
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.policy [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e34182d4a774631bafacee47c987a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbdbbaa0b1c4805960775f6ffb5dcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:57:22 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:57:22 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp791p1w8b/privsep.sock']
Nov 02 22:57:22 user sudo[86317]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp791p1w8b/privsep.sock
Nov 02 22:57:22 user sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 22:57:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:24 user sudo[86317]: pam_unix(sudo:session): session closed for user root
Nov 02 22:57:24 user nova-compute[74721]: INFO oslo.privsep.daemon [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Spawned new privsep daemon via rootwrap
Nov 02 22:57:24 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 22:57:24 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 22:57:24 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 02 22:57:24 user nova-compute[74721]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86336
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06215ae0-c3bb-4a21-a29f-94b8b2cc51ea]: (2,) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully created port: 6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing instance network info cache due to event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0868a038-9871-47f7-b3da-c2c360e7788b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: WARNING os_brick.initiator.connectors.nvmeof [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66ac2b-a284-4811-bdc7-9fe96621faaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2b1016-fbdf-4546-b457-17c2eca1807f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[685055bc-6f0f-4b4f-87db-c109978a8d8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:24 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:57:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54208d-48d2-4533-ab7b-40fc46697068]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== get_connector_properties: return (1849ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:57:24 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating existing volume attachment record: b1c29595-e98e-445c-bf3c-d84921c09aea {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated VIF entry in instance network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-changed-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Refreshing instance network info cache due to event network-changed-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Refreshing network info cache for port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5b57580-4f18-4d6d-b73b-18ceabf9cf4d req-6c6d0e2a-ce00-4f50-8516-2f38a38dc10b service nova] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully created port: a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updated VIF entry in instance network info cache for port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully created port: 57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6f254299-380c-41c5-abf7-3cc050016084 req-00e03d02-1ead-4cd5-a957-b10844ce7d7b service nova] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:57:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:57:26 user nova-compute[74721]: INFO nova.compute.manager [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] instance snapshotting
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Beginning live snapshot process
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully created port: 1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json -f qcow2" returned: 0 in 0.247s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.246s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf.delta 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf.delta 1073741824" returned: 0 in 0.076s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 22:57:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74721) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 02 22:57:27 user nova-compute[74721]: INFO nova.virt.libvirt.host [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] UEFI support detected
Nov 02 22:57:27 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully created port: 919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-changed-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Refreshing instance network info cache due to event network-changed-d0b517f6-e930-4e60-8193-2aa28648ac45. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Refreshing network info cache for port d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updated VIF entry in instance network info cache for port d0b517f6-e930-4e60-8193-2aa28648ac45. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-44389029-dd42-4cfb-bb1a-735f8a30a5f9 req-a7ed9752-4b16-4df3-a768-288e35565951 service nova] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] COPY block job progress, current cursor: 786432 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-6c248aba-4058-4f40-ab25-4edccbffbac2. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 22:57:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 22:57:28 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 22:57:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf.delta /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10cdd13c-cea9-4047-a91c-b8b66b2fde8d req-4a0a49ab-ae0c-454d-9bd0-fe9dfc69632f service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf.delta /opt/stack/data/nova/instances/snapshots/tmpi34vy1pp/d707908d55a743bfa2b8061a3aeb1aaf" returned: 0 in 0.526s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Snapshot extracted, beginning image upload
Nov 02 22:57:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing instance network info cache due to event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG nova.network.neutron [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated VIF entry in instance network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG nova.network.neutron [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-437f1015-ff86-4b60-9356-20595e0c1773 req-65f3fbc7-3b80-4017-beda-e48b199fb18d service nova] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-58222433-a0d5-462c-825e-803a15173831. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.network.neutron [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:31 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:57:31 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7240MB free_disk=25.5777587890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.network.neutron [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 57e7fd79-796c-4531-bedd-969b531c343f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 373a06ee-b138-4325-b1f5-99e52d5355ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.network.neutron [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-27f094c3-7a8e-4c89-b2b9-73f81f46265f req-96815fcf-a2e3-45b8-9b3a-5cf69b1c5096 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-3dfeee28-dee7-4b73-ad7a-73398fe62b77. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:32 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Snapshot image upload complete
Nov 02 22:57:32 user nova-compute[74721]: INFO nova.compute.manager [None req-79409006-dbb1-4792-9317-31d4d8d2b599 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Took 6.61 seconds to snapshot the instance on the hypervisor.
Nov 02 22:57:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-a725e652-27f1-4b26-bbf7-3ae8d8b09e70. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd956220-8726-42f0-a556-7c05549ee97d req-b7b21adb-5d95-4717-848d-5c4746d02594 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Successfully updated port: 919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:34 user nova-compute[74721]: INFO nova.compute.manager [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Attaching volume df05287d-23e4-46c6-8726-3dc1d326c8c6 to /dev/vdb
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.utils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1208df1-14b5-406c-ae9e-a411d9d707ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6472181-5ff1-4779-a665-ea77aa995dd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba96379-4d0e-4ae4-a89d-b1244811c75b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c2aaa4-c119-4035-a4ec-8963118ff1a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:34 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfcfc0d-f265-4d01-a105-7b7fc94493d6]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG os_brick.utils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating existing volume attachment record: 8d1c7c11-3e84-410d-8c9f-d86b4ed3f492 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-57bb8303-4cf0-4772-99e7-b9fa7d796e9f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance network_info: |[{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:35 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updated VIF entry in instance network info cache for port 57bb8303-4cf0-4772-99e7-b9fa7d796e9f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updated VIF entry in instance network info cache for port 1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-919a774d-ae56-4e37-8e8e-afb72a999938. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updated VIF entry in instance network info cache for port 919a774d-ae56-4e37-8e8e-afb72a999938. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b913f48-e661-4784-8ea5-f4e2ec6115f3 req-c46dc3c1-cf09-48a9-bc06-55055dc96e15 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:57:40 user nova-compute[74721]: INFO nova.compute.claims [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Claim successful on node user
Nov 02 22:57:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received event network-changed-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Refreshing instance network info cache due to event network-changed-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] Acquiring lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] Acquired lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Refreshing network info cache for port 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:57:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:57:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:57:41 user nova-compute[74721]: INFO nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Booting with volume 6e5b465f-ca6a-48fe-8ac3-0c5a297b263d at /dev/vda
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.policy [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd8b427e6174283be4beb2fdc8fa65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435a346312f2486c8f3608b2ccd87751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0517a-d4da-47e2-a655-9d96cac57b9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ada6a38-5bf4-4c18-8694-2153ed4d4d34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598d8c4-50e2-4e92-afef-34991c0824fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36540c-8a37-4011-b589-cc9bed4adaf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updated VIF entry in instance network info cache for port 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:57:41 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b3a8a-7d55-4c7f-8190-b0994c048891]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating existing volume attachment record: c1063b31-89b7-4e4e-b0c0-41dc5186c9a6 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f377514f-8ca9-41ea-a242-a46341bd72e6 req-934a490a-eeab-40b1-81ea-ad9a28cb9aa5 service nova] Releasing lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully created port: 483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully created port: f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully created port: d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully created port: 5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully created port: d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:57:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: 483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-483244bf-572e-4243-b8e0-dfc60d29a3fa. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port 483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-baa2375a-0954-40e6-9067-24c4f95fc64c req-87dd65d7-ac1b-4631-93cb-0f2ec08088cf service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: 63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-63e5181a-a169-4372-9c3d-f77aa795e6d2. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port 63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-f77f280c-4beb-4114-bfac-bd4a698cd0e3. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ccb5d00f-4762-4b59-9fda-b17f13673e13 req-17b027ba-d4cd-4885-b798-f5f80ac9d9f2 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: 5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Successfully updated port: d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:57:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:57:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-d5c644c1-2364-4442-b23d-df99f33ecd4b. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance network_info: |[{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updated VIF entry in instance network info cache for port d5c644c1-2364-4442-b23d-df99f33ecd4b. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-5c9097b3-ff85-4e46-bc3a-91671ebf532a. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port 5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updated VIF entry in instance network info cache for port 5c9097b3-ff85-4e46-bc3a-91671ebf532a. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-d23f2fc9-2f80-46b7-93d5-a5ec18a32370. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updated VIF entry in instance network info cache for port d23f2fc9-2f80-46b7-93d5-a5ec18a32370. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d36093da-9137-43ff-a937-fec6283bd7c4 req-21c0495a-c697-4493-9009-4b8fe218ea55 service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-changed-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Refreshing instance network info cache due to event network-changed-4855034d-41d3-464b-b24c-f0c865ae6f41. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] Acquiring lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] Acquired lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG nova.network.neutron [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Refreshing network info cache for port 4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG nova.network.neutron [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updated VIF entry in instance network info cache for port 4855034d-41d3-464b-b24c-f0c865ae6f41. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG nova.network.neutron [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating instance_info_cache with network_info: [{"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6a28fda7-2e24-41d6-9477-453ad37a2207 req-10c6ec5d-2e31-4bfd-ab53-e25bef2848d7 service nova] Releasing lock "refresh_cache-57e7fd79-796c-4531-bedd-969b531c343f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connector [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Factory for ISCSI on None {{(pid=74721) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:57:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:57:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:57:59 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[45150782-1b64-4540-8777-e8ab1e9ea06a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:57:59 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf86649-9e36-4309-8522-7ca61afcf083]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6] added
Nov 02 22:57:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36131ad-28b2-4a19-b566-3aaeb7f75c90]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d519a-293d-4d50-9f70-882de94446a0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYiCGjWf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYiCGjWf" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe3bce0-66ca-4e6b-b4e4-5b5b5a3838e6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYiCGjWf'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a39774-42c9-457a-85cb-4dd08dbb7c18]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b1d7d-3db0-4c93-bc5d-66a7d7c84d0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 22:57:59 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 22:57:59 user nova-compute[74721]:  {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:57:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 22:57:59 user nova-compute[74721]: 
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbc406f-6152-464b-8ce3-1797cd18c8d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]
Nov 02 22:57:59 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.
Nov 02 22:57:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f157d4-7a6e-4d3d-b6a8-1d7a6b1d6371]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e313b-5b38-4604-821a-19f5e0737afb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:57:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:57:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57e1cd1-cf6f-4799-b957-16ac7aa028d7]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-changed-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Refreshing instance network info cache due to event network-changed-8435099b-ed0e-41cc-a0cb-15abc14df2ce. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] Acquiring lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] Acquired lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Refreshing network info cache for port 8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'flavor' on Instance uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lazy-loading 'flavor' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updated VIF entry in instance network info cache for port 8435099b-ed0e-41cc-a0cb-15abc14df2ce. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updating instance_info_cache with network_info: [{"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88b2a423-dbe0-4486-afeb-f49844816b41 req-15fb5f3d-72b6-4190-b17a-0575e20f3401 service nova] Releasing lock "refresh_cache-102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:59 user nova-compute[74721]: INFO nova.compute.manager [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Attaching volume 25c8fe50-cca3-4579-b2a3-cb04a253b61c to /dev/vdb
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:57:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:57:59 user nova-compute[74721]: INFO nova.compute.manager [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attaching volume 9854c732-f547-48c0-9e23-a2d38411b2b0 to /dev/vdb
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e57b23-c709-4263-9535-0797c44d6608]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ddffc-01c9-4d6b-9850-30e7ae744f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26233663166383536', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233663166383536', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f93ec-b6db-498a-857d-905ec260164a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a8cbb-17a9-4815-9203-2296bd95cd75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 22:58:00 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:58:00 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 22:58:00 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:58:00 user nova-compute[74721]:   <serial>df05287d-23e4-46c6-8726-3dc1d326c8c6</serial>
Nov 02 22:58:00 user nova-compute[74721]: </disk>
Nov 02 22:58:00 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006cbe8-6b7a-47f3-9088-7c43de090d74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:00 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e31819-12f9-4d04-bbde-25eecca2cc67]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating existing volume attachment record: 639327f0-d922-41d7-9d76-5e6989e31fce {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad143c6-fca5-4fa2-9a32-d4115502e97b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518c42c-38f1-4f47-ba97-64246491059a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61564fc2-c2b0-4771-b0cd-40b661224f03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:00 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2f82f4-14d3-492b-b68f-6e4745e1474a]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updating existing volume attachment record: 83e7d4f9-b154-4576-bea3-9b50b95d1b87 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No VIF found with MAC fa:16:3e:ce:ca:8f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-changed-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing instance network info cache due to event network-changed-daef9cf0-de2c-4719-84a6-f5999eaa9204. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing network info cache for port daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updated VIF entry in instance network info cache for port daef9cf0-de2c-4719-84a6-f5999eaa9204. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:58:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f0a8df0b-d9eb-4dcd-99bd-b6f4cc08f855 req-0cd5dac5-f741-486f-9f75-23b9a9611677 service nova] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-changed-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Refreshing instance network info cache due to event network-changed-05c8c59a-f285-4876-9c9b-9d86a1a0137c. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] Acquiring lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] Acquired lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Refreshing network info cache for port 05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'pci_requests' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.objects.base [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Object Instance<65971139-4ea2-4c05-b4ec-beb6e91bb571> lazy-loaded attributes: flavor,pci_requests {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.policy [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1143bb233a7247e5bde80acd173b10a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b3e882b89446fbae7d5b65f973bf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updated VIF entry in instance network info cache for port 05c8c59a-f285-4876-9c9b-9d86a1a0137c. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating instance_info_cache with network_info: [{"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96572c8e-4e81-4346-b8f2-c50eb63f6c8d req-9f5fe004-2ca1-4c1f-9d03-c9a66bb1c7a5 service nova] Releasing lock "refresh_cache-5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:58:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Successfully created port: a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Successfully updated port: a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG os_vif [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8356ee93-d2a2-5ba3-91a0-9296e1710af5', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa49f3161-72, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa49f3161-72, col_values=(('qos', UUID('d8173053-93ed-43ca-b199-ff9971aac4ee')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa49f3161-72, col_values=(('external_ids', {'iface-id': 'a49f3161-72f9-4437-9d7c-a87d4c834918', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:d3:45', 'vm-uuid': '65971139-4ea2-4c05-b4ec-beb6e91bb571'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:58:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: INFO os_vif [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72')
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] attach device xml: <interface type="ethernet">
Nov 02 22:58:05 user nova-compute[74721]:   <mac address="fa:16:3e:c2:d3:45"/>
Nov 02 22:58:05 user nova-compute[74721]:   <model type="virtio"/>
Nov 02 22:58:05 user nova-compute[74721]:   <mtu size="1442"/>
Nov 02 22:58:05 user nova-compute[74721]:   <target dev="tapa49f3161-72"/>
Nov 02 22:58:05 user nova-compute[74721]: </interface>
Nov 02 22:58:05 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-changed-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing instance network info cache due to event network-changed-a49f3161-72f9-4437-9d7c-a87d4c834918. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Refreshing network info cache for port a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:58:05 user nova-compute[74721]: WARNING nova.compute.manager [req-adb573df-2c4f-4d84-9373-341630746f70 req-9551d17e-8f3e-4070-9082-a95371d326ed service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 for instance with vm_state active and task_state None.
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name hda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No VIF found with MAC fa:16:3e:80:bf:49, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:58:05 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:creationTime>2023-11-02 22:58:05</nova:creationTime>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 22:58:05 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 22:58:05 user nova-compute[74721]:   </nova:flavor>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:owner>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 22:58:05 user nova-compute[74721]:   </nova:owner>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:58:05 user nova-compute[74721]:   <nova:ports>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 22:58:05 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 22:58:05 user nova-compute[74721]:     </nova:port>
Nov 02 22:58:05 user nova-compute[74721]:     <nova:port uuid="a49f3161-72f9-4437-9d7c-a87d4c834918">
Nov 02 22:58:05 user nova-compute[74721]:       <nova:ip type="fixed" address="10.10.10.47" ipVersion="4"/>
Nov 02 22:58:05 user nova-compute[74721]:     </nova:port>
Nov 02 22:58:05 user nova-compute[74721]:   </nova:ports>
Nov 02 22:58:05 user nova-compute[74721]: </nova:instance>
Nov 02 22:58:05 user nova-compute[74721]:  {{(pid=74721) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2c79923c-cba0-49b2-a8ea-659f33614270 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.133s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updated VIF entry in instance network info cache for port a49f3161-72f9-4437-9d7c-a87d4c834918. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-90abc929-1dd4-4358-8975-b684913266e3 req-fc078182-8615-4caa-83cd-cc76325f0fbc service nova] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:58:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2d693e9b-bc08-4546-968b-49c1d310faa8 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.920s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lazy-loading 'flavor' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:06 user nova-compute[74721]: INFO nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Booting with volume 6e338d1a-860e-479e-bf8b-f5d9e5ef04df at /dev/vdb
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lazy-loading 'flavor' on Instance uuid 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:06 user nova-compute[74721]: INFO nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Booting with volume ec253e27-90a2-4b9f-a437-118938d6ee8c at /dev/vdb
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eb773b-d86f-46cc-84c9-8e1da8a66cc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ed6e5-25ad-43e5-a7b9-165c1bc72263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c20a79-193f-427a-a457-eb0a27a5cd14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b05d301-0262-4694-befe-c7bd945e6764]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:06 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bfdc5f-4be6-4a92-9852-cdaac4f403ad]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating existing volume attachment record: e1e6b7ed-74a9-419b-a0cd-ee5c6e3df688 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:06 user nova-compute[74721]: INFO nova.compute.manager [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Attaching volume 190e671b-2f9b-4d78-a662-12d2ef29ffa8 to /dev/vdb
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:07 user nova-compute[74721]: INFO nova.compute.manager [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Attaching volume bd916779-dd6b-40ae-aec7-060fbd9c393f to /dev/vdb
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48fb3e-fc8f-4804-822c-82e0aa71eb88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[269dbfff-2f19-4fc2-a5dd-e87575e5e55c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1b8a3-6cec-465b-af31-6565c4245841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8381a3-46bb-4b4c-bb32-0f30624f047e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:07 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02b007-d2f9-405f-bd95-dc2f60e3167c]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating existing volume attachment record: d9f46ef8-930f-4e1c-8292-240a5ec4fa6e {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74721) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:07 user nova-compute[74721]: INFO nova.compute.manager [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Attaching volume daf211a8-4e08-4a42-becc-c872dba78fe1 to /dev/sdc
Nov 02 22:58:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:58:07 user nova-compute[74721]: WARNING nova.compute.manager [req-e6e63f00-1637-4a24-a600-a211e5479e5a req-2bd6de90-cc12-464f-9eb5-a888cf2548fb service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 for instance with vm_state active and task_state None.
Nov 02 22:58:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:58:07 user nova-compute[74721]: WARNING nova.compute.manager [req-d553d0e3-a4e8-4b00-b973-69e1294f3ee4 req-62ec1444-0a51-4a22-bc2b-d45dee4d88ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state powering-off.
Nov 02 22:58:08 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance destroyed successfully.
Nov 02 22:58:08 user nova-compute[74721]: DEBUG nova.compute.manager [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:58:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-96ea8c31-6f09-4e30-be3d-3fe9507b9bb9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.062s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:58:09 user nova-compute[74721]: WARNING nova.compute.manager [req-0ded558c-331f-4ce4-b205-5a3f7ac35f53 req-5be3966d-089d-49b5-b9b2-500edd7959da service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state None.
Nov 02 22:58:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApcxZkVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:21 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:58:21 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:58:21 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1e179-d20f-41f0-97db-0c7377c58f92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:58:21 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddce241-4e4b-4987-ab52-3b5872afc0af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c] added
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0047e8-4462-435a-a7dc-29716a157354]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[493210fd-7bd1-44cb-9f10-4d5fd29d25d1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApcxZkVP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApcxZkVP" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bf37b-c02e-4bec-a9d1-242c5e2e4425]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApcxZkVP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d052ceb8-e200-40ba-ab4b-8670558b74a6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[01acab96-dec5-4628-b3bc-e4b42d411a4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d14dc-264c-4f57-b035-b7fb5d60c10f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260]
Nov 02 22:58:21 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260] successful.
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70145e4f-0ecd-40d9-88bb-cc116cddb0f7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cb0223-3085-4327-bb7a-34262fda4ab4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:21 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:21 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a0554-3c39-491b-a1da-89aefbe54293]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApcxZkVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:58:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23639666539373538', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639666539373538', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'flavor' on Instance uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 22:58:22 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:58:22 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 22:58:22 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:58:22 user nova-compute[74721]:   <serial>25c8fe50-cca3-4579-b2a3-cb04a253b61c</serial>
Nov 02 22:58:22 user nova-compute[74721]: </disk>
Nov 02 22:58:22 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No VIF found with MAC fa:16:3e:bd:e3:6f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:58:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:58:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:27 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:31 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:58:31 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:58:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.5159912109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:58:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 57e7fd79-796c-4531-bedd-969b531c343f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 373a06ee-b138-4325-b1f5-99e52d5355ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 0241e103-9dcc-41ac-a2ff-27dc56ffc557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:58:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:58:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.utils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e052234-cefc-476b-8508-77837cc3f67c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d77171b-3c7b-465b-9e85-126ebaca2af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.utils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff693e67-af94-41a6-8b78-b1a3347c44c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[535b94aa-2696-4d5e-828f-21c54397d146]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e782c52-7ed6-4502-949f-480361305d35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:42 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16196b0a-9c9a-4976-bdca-922c8c2d7176]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.utils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating existing volume attachment record: 505edd90-2f1d-4822-81c4-f9e0c865410a {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9269b-eb5d-4e73-87ef-dedb575bab24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4761ed84-f1dc-40cc-87d1-bec9d260cfd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08d427-4d2e-4fef-a555-d1c3322c8cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:42 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f999ec0-0a15-4517-99d0-58c9a3afc039]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.utils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating existing volume attachment record: 17fedc08-b87e-4b58-b240-9baa0cab1a07 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-283603d0-91f4-49c4-adcc-e5e19243d75d tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.085s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG os_brick.utils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c8539-d4b4-40b1-92d9-7b5abe592d29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c67284-8390-4ca4-ba44-e4977d2fb14e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be6d8bf-d2fb-4363-bf0b-136361d54b6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01fe8e5-6df3-440d-a4f3-42a14fec26f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:58:43 user nova-compute[74721]: INFO nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Booting with volume a39f9e2b-1311-4ba3-b32c-166dac96f29b at /dev/vdc
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:58:43 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:58:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eef761-294d-434e-91ef-f3000d6f411c]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG os_brick.utils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:43 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating existing volume attachment record: 082609a4-a040-4a72-b01a-f9b5609d7601 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:58:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:58:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:58:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:58:47 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293e6df-2e82-4ae9-8917-a7b6ab175183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:58:47 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6874a-b0a2-4436-acbd-cade06859850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0] added
Nov 02 22:58:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ebf74-06f4-4ce2-b7df-edc48719f505]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e07c8b-b657-4e6e-b565-b5be1c53e65f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLWvDOSK {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLWvDOSK" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8953f3d-8492-4b4b-a686-4d765242a20e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLWvDOSK'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b96ad01-0775-421a-b9a2-037403f3cac7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc10b3df-c7e4-490c-8a28-366f65408335]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae940e0b-0f58-4cd3-b568-09effa4cc6d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]
Nov 02 22:58:48 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.
Nov 02 22:58:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7e270-615f-4180-a234-0d97a28804bd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e74bc5c-3364-4eff-ac6a-0d49b3aa43d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:58:48 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:58:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9970a99-6a6d-4248-906a-ec4ea51dc52b]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:58:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23331666363663563', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331666363663563', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lazy-loading 'flavor' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 22:58:49 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:58:49 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 22:58:49 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:58:49 user nova-compute[74721]:   <serial>9854c732-f547-48c0-9e23-a2d38411b2b0</serial>
Nov 02 22:58:49 user nova-compute[74721]: </disk>
Nov 02 22:58:49 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:58:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] No VIF found with MAC fa:16:3e:0c:f1:3a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:58:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:58:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcnaMxDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:04 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:04 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:04 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6e7767-fef4-441f-9aac-a5d2017027f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:04 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9655c6-4a17-4599-b492-cdc370b3a76d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8] added
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f1ec8-4cc3-4c0c-b33b-905c43334dd2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d00eecb-19ac-4b45-81f7-751c48095829]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcnaMxDm {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcnaMxDm" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0adddb-eb20-4444-b370-ca42adf06a55]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HcnaMxDm'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[52392367-2f3e-4c73-b228-6c06951debdd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b3eb93-fffc-4bbe-8b8a-af7759021f93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0da63-44a6-4e56-b672-38be22f7bd95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260]
Nov 02 22:59:04 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25c711-e1c9-4fcf-8312-137b277b75e0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3951c0ab-3f0a-4bc6-88d2-4ac1e90cb833]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6d321-ad02-4e3d-83a2-769496d67e1c]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcnaMxDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:04 user nova-compute[74721]: INFO nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Booting with volume 85c05348-1b74-47b4-8a71-108a9256c3c0 at /dev/vdc
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8861bb-e36a-4313-8bbd-c893fac648ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785ef2d-7d8b-4fa0-a27d-7bb3aca2122a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbdda40-5558-4519-92e6-55bae558b2d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166febd-067d-406a-9e4f-cdeea26dabf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:04 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c80fc-e959-4582-8be0-9f5eb57f19e0]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG os_brick.utils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating existing volume attachment record: d93a1c74-3b1f-4947-bc1f-a3855d797479 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:59:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b3baacf8-f1e1-483a-89e3-630fa5d60c0f tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.797s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26662383461663166', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662383461663166', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lazy-loading 'flavor' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] attach device xml: <disk type="block" device="disk">
Nov 02 22:59:05 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:05 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 22:59:05 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:05 user nova-compute[74721]:   <serial>190e671b-2f9b-4d78-a662-12d2ef29ffa8</serial>
Nov 02 22:59:05 user nova-compute[74721]: </disk>
Nov 02 22:59:05 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:59:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] No VIF found with MAC fa:16:3e:53:4e:f8, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:59:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 22:59:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:59:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:59:23 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 22:59:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce4d61-96d9-46bb-a930-87af8e7d150a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:26 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4d9f2-b7d0-4a18-92d7-6ea113bfb380]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dc5d9b-a1bc-41c2-b7f5-4dcc62f37c77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec8819-1b3c-422d-b3ff-619cdaa3d9fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:27 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8effce48-0bae-4d4d-b003-7e9080d2d95d]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG os_brick.utils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating existing volume attachment record: 050e3a57-5522-4e13-a16e-e583191f2535 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3140af0d-54c8-4b4a-bb38-a280a93e38b6 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.313s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:59:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Creating image(s)
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Ensure instance console log exists: /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Start _get_guest_xml network_info=[{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'c1063b31-89b7-4e4e-b0c0-41dc5186c9a6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siIdjPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0241e103-9dcc-41ac-a2ff-27dc56ffc557', 'attached_at': '', 'detached_at': '', 'volume_id': '6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 'serial': '6e5b465f-ca6a-48fe-8ac3-0c5a297b263d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': 'd9f46ef8-930f-4e1c-8292-240a5ec4fa6e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJRIGnmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0241e103-9dcc-41ac-a2ff-27dc56ffc557', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec253e27-90a2-4b9f-a437-118938d6ee8c', 'serial': 'ec253e27-90a2-4b9f-a437-118938d6ee8c'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': 'd93a1c74-3b1f-4947-bc1f-a3855d797479', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiYOAUru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0241e103-9dcc-41ac-a2ff-27dc56ffc557', 'attached_at': '', 'detached_at': '', 'volume_id': 'a39f9e2b-1311-4ba3-b32c-166dac96f29b', 'serial': 'a39f9e2b-1311-4ba3-b32c-166dac96f29b'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:59:28 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:28 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siIdjPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:28 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:28 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:28 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee232dae-f73e-4aee-80e7-6d6d8d5af397]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:28 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfce4812-025d-4603-9905-fb981659938c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d] added
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7a3ac4-71c3-4154-b5d1-42c5a90a5f3c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b9ad30-e2c9-41c5-b961-4d91f801c77e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siIdjPhQ {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siIdjPhQ" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf0ad32-8811-448f-9abe-8d58875ce34f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'siIdjPhQ'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc9b63-a58b-49a4-a273-5b0c8733b96c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[464d497b-935f-4333-838f-f32985958576]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb398a-e09a-4ee0-98c6-b3a411502433]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260]
Nov 02 22:59:28 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f795f53e-fc23-422d-a188-3a49c40a41bb]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc32f9-af6c-4e52-9bed-a88dcc6cc2f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:28 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b1dd6-93a2-4dec-b07e-77b5ac24bcd5]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siIdjPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:28 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26632633863616532', 'path': '/dev/sdf'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632633863616532', 'path': '/dev/sdf'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJRIGnmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:29 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:29 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:29 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86cd26d-6872-4455-ba84-9d75041cdd0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:29 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c816c-33a1-4f44-b551-3393df7ffe8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c] added
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c105b49-7adf-4190-b176-f4ae58a25efe]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[036a4bdd-176d-4830-96a6-f4f742a0ab01]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJRIGnmA {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJRIGnmA" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75cd60a-a841-45c2-99bc-307ecb679758]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJRIGnmA'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261dd1e-9c75-47cb-b6f7-7e912d67b644]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[981271a5-ecb5-4f43-acbf-d24f2dc486bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e6e8a6-cfa7-464d-8859-3b7cf712b903]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260]
Nov 02 22:59:29 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf489186-c08b-4d5d-a51c-d6462c42c86f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8df04-25d2-4bfa-8fba-4d105eec6bb8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:29 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5722f87-f5ce-4ca0-acba-8554e24fb040]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJRIGnmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26634313966336339', 'path': '/dev/sdg'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634313966336339', 'path': '/dev/sdg'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiYOAUru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:30 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:30 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:30 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b048a48-34d5-4e48-9064-40c3e324d842]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:30 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 22:59:30 user nova-compute[74721]: INFO nova.compute.claims [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Claim successful on node user
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0dfa5-c4f8-4c08-bddb-1143df7e8fa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b] added
Nov 02 22:59:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb8684-89ed-4ef8-9130-887d069b5719]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1a7964-74f5-45c3-a35b-3a341f3a35b0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiYOAUru {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiYOAUru" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9956b-d15c-4b6d-a93b-46662d9b5157]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PiYOAUru'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[23723fc9-9c5f-4556-b6ba-ae922b0878e1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82ac93-09f7-4023-a4ae-73d9e17e84cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[315ee7ad-acbb-4b5a-85c6-a247c433201f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260]
Nov 02 22:59:31 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe736f-4afa-41a5-b749-59e630e478be]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d8b35-848c-45e8-9f3a-6ce68a75e76e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:31 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdebcc0-9747-416c-9331-4833d5dde496]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiYOAUru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 22:59:31 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.policy [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d3fb4cd21c349a1b60f075ffa63f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9ed314de1541b6854e6158ee0816a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:59:31 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Creating image(s)
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SACWtFBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:31 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lacUOwLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:31 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.objects.instance [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'flavor' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.218s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk 1073741824" returned: 0 in 0.068s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26663633435306436', 'path': '/dev/sdh'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633435306436', 'path': '/dev/sdh'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.452s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:32 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:32 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5e790f-42c7-46dd-a3e2-fdcc76fcfdb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:32 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lazy-loading 'pci_devices' on Instance uuid 0241e103-9dcc-41ac-a2ff-27dc56ffc557 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffee56-a59d-401d-8e6d-7b9c5b7144b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f] added
Nov 02 22:59:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:59:32 user nova-compute[74721]:   <uuid>0241e103-9dcc-41ac-a2ff-27dc56ffc557</uuid>
Nov 02 22:59:32 user nova-compute[74721]:   <name>instance-0000000b</name>
Nov 02 22:59:32 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:59:32 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:59:32 user nova-compute[74721]:   <metadata>
Nov 02 22:59:32 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:59:32 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:name>tempest-device-tagging-server-106389717</nova:name>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:59:28</nova:creationTime>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:59:32 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:59:32 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:owner>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:user uuid="0fd8b427e6174283be4beb2fdc8fa65c">tempest-TaggedBootDevicesTest-1605118171-project-member</nova:user>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:project uuid="435a346312f2486c8f3608b2ccd87751">tempest-TaggedBootDevicesTest-1605118171</nova:project>
Nov 02 22:59:32 user nova-compute[74721]:       </nova:owner>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:59:32 user nova-compute[74721]:       <nova:ports>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="483244bf-572e-4243-b8e0-dfc60d29a3fa">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="63e5181a-a169-4372-9c3d-f77aa795e6d2">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="f77f280c-4beb-4114-bfac-bd4a698cd0e3">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="d5c644c1-2364-4442-b23d-df99f33ecd4b">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="5c9097b3-ff85-4e46-bc3a-91671ebf532a">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:         <nova:port uuid="d23f2fc9-2f80-46b7-93d5-a5ec18a32370">
Nov 02 22:59:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 22:59:32 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:32 user nova-compute[74721]:       </nova:ports>
Nov 02 22:59:32 user nova-compute[74721]:     </nova:instance>
Nov 02 22:59:32 user nova-compute[74721]:   </metadata>
Nov 02 22:59:32 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:59:32 user nova-compute[74721]:     <system>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="serial">0241e103-9dcc-41ac-a2ff-27dc56ffc557</entry>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="uuid">0241e103-9dcc-41ac-a2ff-27dc56ffc557</entry>
Nov 02 22:59:32 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:59:32 user nova-compute[74721]:     </system>
Nov 02 22:59:32 user nova-compute[74721]:   </sysinfo>
Nov 02 22:59:32 user nova-compute[74721]:   <os>
Nov 02 22:59:32 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:59:32 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:59:32 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:59:32 user nova-compute[74721]:   </os>
Nov 02 22:59:32 user nova-compute[74721]:   <features>
Nov 02 22:59:32 user nova-compute[74721]:     <acpi/>
Nov 02 22:59:32 user nova-compute[74721]:     <apic/>
Nov 02 22:59:32 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:59:32 user nova-compute[74721]:   </features>
Nov 02 22:59:32 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:59:32 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:59:32 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:59:32 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:59:32 user nova-compute[74721]:   </clock>
Nov 02 22:59:32 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:59:32 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:59:32 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:59:32 user nova-compute[74721]:   </cpu>
Nov 02 22:59:32 user nova-compute[74721]:   <devices>
Nov 02 22:59:32 user nova-compute[74721]:     <disk type="file" device="cdrom">
Nov 02 22:59:32 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 22:59:32 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/disk.config"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="hda" bus="ide"/>
Nov 02 22:59:32 user nova-compute[74721]:     </disk>
Nov 02 22:59:32 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:32 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:32 user nova-compute[74721]:       <source dev="/dev/sdf"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <serial>6e5b465f-ca6a-48fe-8ac3-0c5a297b263d</serial>
Nov 02 22:59:32 user nova-compute[74721]:     </disk>
Nov 02 22:59:32 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:32 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:32 user nova-compute[74721]:       <source dev="/dev/sdg"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <serial>ec253e27-90a2-4b9f-a437-118938d6ee8c</serial>
Nov 02 22:59:32 user nova-compute[74721]:     </disk>
Nov 02 22:59:32 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:32 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:32 user nova-compute[74721]:       <source dev="/dev/sdh"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="vdc" bus="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <serial>a39f9e2b-1311-4ba3-b32c-166dac96f29b</serial>
Nov 02 22:59:32 user nova-compute[74721]:     </disk>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:bd:3b:18"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tap483244bf-57"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:a0:9b:46"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tape22c445c-6b"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:73:79:00"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tap63e5181a-a1"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:2d:18:17"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tapf77f280c-4b"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:5c:3f:cb"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tapd5c644c1-23"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:b0:a6:c9"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tap5c9097b3-ff"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:32 user nova-compute[74721]:       <mac address="fa:16:3e:84:45:68"/>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:32 user nova-compute[74721]:       <target dev="tapd23f2fc9-2f"/>
Nov 02 22:59:32 user nova-compute[74721]:     </interface>
Nov 02 22:59:32 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:59:32 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/console.log" append="off"/>
Nov 02 22:59:32 user nova-compute[74721]:     </serial>
Nov 02 22:59:32 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:59:32 user nova-compute[74721]:     <video>
Nov 02 22:59:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:32 user nova-compute[74721]:     </video>
Nov 02 22:59:32 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:59:32 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:59:32 user nova-compute[74721]:     </rng>
Nov 02 22:59:32 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:59:32 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:59:32 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:59:32 user nova-compute[74721]:     </memballoon>
Nov 02 22:59:32 user nova-compute[74721]:   </devices>
Nov 02 22:59:32 user nova-compute[74721]: </domain>
Nov 02 22:59:32 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[56792541-bb50-4e93-a848-2492cf0c4ff4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '142f31ba-4bb3-5fdf-b281-4df88c42212d', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.249s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f85a61-7cf3-4ffe-92cc-ffb19a5a3851]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Successfully created port: 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SACWtFBN {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:32 user nova-compute[74721]: INFO nova.compute.manager [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attaching volume b98da9af-12db-4295-87d7-fbd1b0314551 to /dev/vdb
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SACWtFBN" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c96a139-1bb2-4979-9d16-d79a0b63a4b6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap483244bf-57, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap483244bf-57, col_values=(('qos', UUID('04cdafcc-abd6-44f9-b81b-73048cd7664d')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap483244bf-57, col_values=(('external_ids', {'iface-id': '483244bf-572e-4243-b8e0-dfc60d29a3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:3b:18', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SACWtFBN'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9229f58-5d9f-42d5-aab4-c16c41f35852]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: INFO nova.compute.manager [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Detaching volume 25c8fe50-cca3-4579-b2a3-cb04a253b61c
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57')
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92355121-bf58-5179-a515-a05ed6fce5d6', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] volume_snapshot_create: create_info: {'snapshot_id': 'c9039272-826d-4069-992b-f0b30f15faa2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74721) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Cannot resize image /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Ensure instance console log exists: /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac38f1b0-b9da-4ba8-a36f-4063d2a56970]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] snap xml: <domainsnapshot>
Nov 02 22:59:32 user nova-compute[74721]:   <disks>
Nov 02 22:59:32 user nova-compute[74721]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 02 22:59:32 user nova-compute[74721]:       <source file="/dev/new_file"/>
Nov 02 22:59:32 user nova-compute[74721]:     </disk>
Nov 02 22:59:32 user nova-compute[74721]:     <disk name="vda" snapshot="no"/>
Nov 02 22:59:32 user nova-compute[74721]:   </disks>
Nov 02 22:59:32 user nova-compute[74721]: </domainsnapshot>
Nov 02 22:59:32 user nova-compute[74721]:  {{(pid=74721) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] Lazy-loading 'system_metadata' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape22c445c-6b, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape22c445c-6b, col_values=(('qos', UUID('be33639e-4502-48d3-a3fc-e224a3f5e8ea')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape22c445c-6b, col_values=(('external_ids', {'iface-id': 'e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:9b:46', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8015e1-38ad-46f2-85a3-f545a7dbfedd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b')
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd694be-e3a2-5873-9142-bc701fa306e0', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db19c0-8014-43bb-bf3f-55470bd5f9eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9180bb1-2565-443b-9c9e-fc78ecada9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6e31d2ed-9d90-4a76-8437-e8feb8bf48a6 tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] volume_snapshot_delete: delete_info: {'volume_id': '190e671b-2f9b-4d78-a662-12d2ef29ffa8'} {{(pid=74721) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [None req-6e31d2ed-9d90-4a76-8437-e8feb8bf48a6 tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Traceback (most recent call last):
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     if delete_info['type'] != 'qcow2':
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] KeyError: 'type'
Nov 02 22:59:32 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] 
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9966e95-041d-4e5d-bddc-a011b8c380d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260]
Nov 02 22:59:32 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff6ef3c-8047-4b3c-a070-2acbcdb0f4da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[14061c07-090a-4a5d-896b-3c9ae9764759]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1808066-0cf1-4331-bc4e-5d9e36b54748]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:32 user nova-compute[74721]: INFO nova.virt.block_device [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Attempting to driver detach volume 25c8fe50-cca3-4579-b2a3-cb04a253b61c from mountpoint /dev/vdb
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9cd0f6-771f-4bf7-a218-0c2fff34f788]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de9b40-4068-413d-9990-fb4b8686ca50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:33 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56267f3-f7e0-43ff-b9ae-993a13021bc1]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07e857-a942-4ca9-97d3-717ce135632d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.utils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== get_connector_properties: return (257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e845a4-2e32-472d-bc0f-facfcef67311]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     rv = execute(f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     six.reraise(c, e, tb)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     raise value
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     rv = meth(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     self._volume_snapshot_create(context, instance, guest,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     rv = execute(f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     six.reraise(c, e, tb)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     raise value
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     rv = meth(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] 
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:33 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.745s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [None req-6e31d2ed-9d90-4a76-8437-e8feb8bf48a6 tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4485a416-7749-499f-a0d4-14ea8624a47a)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 22:59:33 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ac6b7-7b27-454d-8134-2281ad44c45c]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.utils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] <== get_connector_properties: return (336ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating existing volume attachment record: e3d0d173-27e1-4e6f-a94b-100c06533fde {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63e5181a-a1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63e5181a-a1, col_values=(('qos', UUID('ba887dcb-e1c4-4ea0-ade1-3efd16f174d6')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63e5181a-a1, col_values=(('external_ids', {'iface-id': '63e5181a-a169-4372-9c3d-f77aa795e6d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:79:00', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10def8-295a-4bb8-97fc-60fb32fff069]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SACWtFBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server [None req-6e31d2ed-9d90-4a76-8437-e8feb8bf48a6 tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] Exception during message handling: KeyError: 'type'
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server 
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Attempting to detach device vdb from instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 22:59:33 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:33 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 22:59:33 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:33 user nova-compute[74721]:   <serial>25c8fe50-cca3-4579-b2a3-cb04a253b61c</serial>
Nov 02 22:59:33 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 22:59:33 user nova-compute[74721]: </disk>
Nov 02 22:59:33 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1')
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b24da62-a5e8-5963-8f3e-475628e45d50', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c9039272-826d-4069-992b-f0b30f15faa2 could not be found.
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise value
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c9039272-826d-4069-992b-f0b30f15faa2 could not be found. (HTTP 404) (Request-ID: req-56cb4324-dafa-46a4-ad97-7a7406611dc1)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c9039272-826d-4069-992b-f0b30f15faa2 could not be found.
Nov 02 22:59:33 user nova-compute[74721]: ERROR nova.virt.libvirt.driver 
Nov 02 22:59:33 user nova-compute[74721]: INFO nova.compute.manager [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Swapping volume 9854c732-f547-48c0-9e23-a2d38411b2b0 for daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Successfully updated port: 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-changed-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Refreshing instance network info cache due to event network-changed-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] Acquiring lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] Acquired lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Refreshing network info cache for port 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server [None req-e079db9e-0134-4b4d-b909-2bb4dfe627ba tempest-VolumesAssistedSnapshotsTest-538647793 tempest-VolumesAssistedSnapshotsTest-538647793-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise value
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 22:59:33 user nova-compute[74721]: ERROR oslo_messaging.rpc.server 
Nov 02 22:59:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully detached device vdb from instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 from the persistent domain config.
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 22:59:33 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:33 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 22:59:33 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:33 user nova-compute[74721]:   <serial>25c8fe50-cca3-4579-b2a3-cb04a253b61c</serial>
Nov 02 22:59:33 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 22:59:33 user nova-compute[74721]: </disk>
Nov 02 22:59:33 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf77f280c-4b, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf77f280c-4b, col_values=(('qos', UUID('9086b06b-91eb-4b38-afcc-4ab27eb51929')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf77f280c-4b, col_values=(('external_ids', {'iface-id': 'f77f280c-4beb-4114-bfac-bd4a698cd0e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:18:17', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.514328002929688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:33 user nova-compute[74721]: INFO nova.compute.manager [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Detaching volume 190e671b-2f9b-4d78-a662-12d2ef29ffa8
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b')
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18a54a50-0d0c-5368-aa05-60a2a4dae3c9', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5c644c1-23, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5c644c1-23, col_values=(('qos', UUID('a42bf767-2c1e-4cdc-ad84-9cf6e43e034c')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5c644c1-23, col_values=(('external_ids', {'iface-id': 'd5c644c1-2364-4442-b23d-df99f33ecd4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:3f:cb', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23')
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b38d108-e145-5368-8c6a-9460ad641b36', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 57e7fd79-796c-4531-bedd-969b531c343f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 373a06ee-b138-4325-b1f5-99e52d5355ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 0241e103-9dcc-41ac-a2ff-27dc56ffc557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c9097b3-ff, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c9097b3-ff, col_values=(('qos', UUID('f97d3c25-d927-4624-85ac-65b957a31685')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c9097b3-ff, col_values=(('external_ids', {'iface-id': '5c9097b3-ff85-4e46-bc3a-91671ebf532a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:a6:c9', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.neutron [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f11e43b-c51e-4d62-9452-05f05f536020 req-f7ed7f6e-6f52-4d32-8314-e1fd10efc0e9 service nova] Releasing lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff')
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea53554c-0ad8-5cb8-9f91-08db4ddf1398', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.812s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] <== connect_volume: return (2263ms) {'type': 'block', 'scsi_wwn': '23961633739393663', 'path': '/dev/sdi'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961633739393663', 'path': '/dev/sdi'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.220s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:34 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bb4f37-52e9-4074-ae10-fee37af55375]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:34 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd23f2fc9-2f, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd23f2fc9-2f, col_values=(('qos', UUID('806fb06e-8dc8-4510-888a-082665ececb0')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd23f2fc9-2f, col_values=(('external_ids', {'iface-id': 'd23f2fc9-2f80-46b7-93d5-a5ec18a32370', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:45:68', 'vm-uuid': '0241e103-9dcc-41ac-a2ff-27dc56ffc557'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 22:59:34 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:34 user nova-compute[74721]:   <source dev="/dev/sdi"/>
Nov 02 22:59:34 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:34 user nova-compute[74721]:   <serial>bd916779-dd6b-40ae-aec7-060fbd9c393f</serial>
Nov 02 22:59:34 user nova-compute[74721]: </disk>
Nov 02 22:59:34 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd3cc54-483f-4378-a38d-b0b36d3543cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1] added
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8baebed-1846-47ea-b8cf-e539fc6bf60b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca063ea3-00a3-4d0d-aff1-36769d0283e4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lacUOwLF {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: INFO os_vif [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f')
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lacUOwLF" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5876f7a4-1dbb-4310-8f88-d5d977973e2b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lacUOwLF'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[692d02c0-5bd0-4425-a3db-5c4ea068fb80]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] No BDM found with device name hda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] No VIF found with MAC fa:16:3e:bd:3b:18, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] No VIF found with MAC fa:16:3e:5c:3f:cb, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Using config drive
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25aea23-2bf5-4bf7-a337-c6fb144913dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3a690-2f49-4c20-8c7c-74368d8479d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260]
Nov 02 22:59:34 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4341250-8942-4a01-90aa-43fe1e5b1c8b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating instance_info_cache with network_info: [{"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e7d142-8a7b-495b-bc64-74a9170b1f29]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:34 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance network_info: |[{"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start _get_guest_xml network_info=[{"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:59:34 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:34 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854175b-5db2-4ac6-ac8b-0b9110acf6db]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lacUOwLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Creating config drive at /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/disk.config
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqbzhpuv8 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-tempest.common.compute-instance-319264424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'pci_devices' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqbzhpuv8" returned: 0 in 0.102s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:59:34 user nova-compute[74721]:   <uuid>28634ace-efa2-45a1-bbd9-9bb3f29bef01</uuid>
Nov 02 22:59:34 user nova-compute[74721]:   <name>instance-0000000c</name>
Nov 02 22:59:34 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:59:34 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:59:34 user nova-compute[74721]:   <metadata>
Nov 02 22:59:34 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:59:34 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:name>tempest-tempest.common.compute-instance-319264424</nova:name>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:59:34</nova:creationTime>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:59:34 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:59:34 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:owner>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:user uuid="2d3fb4cd21c349a1b60f075ffa63f393">tempest-ServerActionsTestOtherA-756381715-project-member</nova:user>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:project uuid="8d9ed314de1541b6854e6158ee0816a0">tempest-ServerActionsTestOtherA-756381715</nova:project>
Nov 02 22:59:34 user nova-compute[74721]:       </nova:owner>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:59:34 user nova-compute[74721]:       <nova:ports>
Nov 02 22:59:34 user nova-compute[74721]:         <nova:port uuid="8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc">
Nov 02 22:59:34 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 22:59:34 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:34 user nova-compute[74721]:       </nova:ports>
Nov 02 22:59:34 user nova-compute[74721]:     </nova:instance>
Nov 02 22:59:34 user nova-compute[74721]:   </metadata>
Nov 02 22:59:34 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:59:34 user nova-compute[74721]:     <system>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="serial">28634ace-efa2-45a1-bbd9-9bb3f29bef01</entry>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="uuid">28634ace-efa2-45a1-bbd9-9bb3f29bef01</entry>
Nov 02 22:59:34 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:59:34 user nova-compute[74721]:     </system>
Nov 02 22:59:34 user nova-compute[74721]:   </sysinfo>
Nov 02 22:59:34 user nova-compute[74721]:   <os>
Nov 02 22:59:34 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:59:34 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:59:34 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:59:34 user nova-compute[74721]:   </os>
Nov 02 22:59:34 user nova-compute[74721]:   <features>
Nov 02 22:59:34 user nova-compute[74721]:     <acpi/>
Nov 02 22:59:34 user nova-compute[74721]:     <apic/>
Nov 02 22:59:34 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:59:34 user nova-compute[74721]:   </features>
Nov 02 22:59:34 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:59:34 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:59:34 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:59:34 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:59:34 user nova-compute[74721]:   </clock>
Nov 02 22:59:34 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:59:34 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:59:34 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:59:34 user nova-compute[74721]:   </cpu>
Nov 02 22:59:34 user nova-compute[74721]:   <devices>
Nov 02 22:59:34 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 22:59:34 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 22:59:34 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk"/>
Nov 02 22:59:34 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:59:34 user nova-compute[74721]:     </disk>
Nov 02 22:59:34 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:34 user nova-compute[74721]:       <mac address="fa:16:3e:3b:45:fe"/>
Nov 02 22:59:34 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:34 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:34 user nova-compute[74721]:       <target dev="tap8a7c3d26-0a"/>
Nov 02 22:59:34 user nova-compute[74721]:     </interface>
Nov 02 22:59:34 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:59:34 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/console.log" append="off"/>
Nov 02 22:59:34 user nova-compute[74721]:     </serial>
Nov 02 22:59:34 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:59:34 user nova-compute[74721]:     <video>
Nov 02 22:59:34 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:34 user nova-compute[74721]:     </video>
Nov 02 22:59:34 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:59:34 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:59:34 user nova-compute[74721]:     </rng>
Nov 02 22:59:34 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:59:34 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:59:34 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:59:34 user nova-compute[74721]:     </memballoon>
Nov 02 22:59:34 user nova-compute[74721]:   </devices>
Nov 02 22:59:34 user nova-compute[74721]: </domain>
Nov 02 22:59:34 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-tempest.common.compute-instance-319264424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG os_vif [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1931d4ca-30e7-56f7-939f-6ae113da3d91', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No BDM found with device name hda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] No VIF found with MAC fa:16:3e:80:bf:49, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a7c3d26-0a, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a7c3d26-0a, col_values=(('qos', UUID('afb83a94-ec63-46e5-b109-13e27225c4fe')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a7c3d26-0a, col_values=(('external_ids', {'iface-id': '8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:45:fe', 'vm-uuid': '28634ace-efa2-45a1-bbd9-9bb3f29bef01'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:34 user nova-compute[74721]: INFO os_vif [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a')
Nov 02 22:59:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:3b:45:fe, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] <== connect_volume: return (3668ms) {'type': 'block', 'scsi_wwn': '26263353832653062', 'path': '/dev/sdj'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263353832653062', 'path': '/dev/sdj'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG nova.objects.instance [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lazy-loading 'flavor' on Instance uuid 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 22:59:35 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:35 user nova-compute[74721]:   <source dev="/dev/sdj"/>
Nov 02 22:59:35 user nova-compute[74721]:   <target dev="sdc" bus="scsi"/>
Nov 02 22:59:35 user nova-compute[74721]:   <serial>daf211a8-4e08-4a42-becc-c872dba78fe1</serial>
Nov 02 22:59:35 user nova-compute[74721]:   <address type="drive" controller="0" unit="2"/>
Nov 02 22:59:35 user nova-compute[74721]: </disk>
Nov 02 22:59:35 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 22:59:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No BDM found with device name sda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 22:59:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] No VIF found with MAC fa:16:3e:f0:da:c1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:37 user nova-compute[74721]: WARNING nova.compute.manager [req-82c6e958-149b-4a34-8de5-1f8d08f9115f req-d99eb789-de47-4a73-b03e-9b2c58ca146e service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa for instance with vm_state building and task_state spawning.
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:38 user nova-compute[74721]: WARNING nova.compute.manager [req-f9b2c386-cc08-4634-a757-c71ee95080dc req-b7348c34-48a6-444f-872f-5477b2ccfa3f service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state building and task_state spawning.
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:38 user nova-compute[74721]: WARNING nova.compute.manager [req-6c8c2fef-8d1a-4f4c-a520-f5d96b9a18a0 req-5d413a02-f9a8-4ff1-8cd9-c617978268c1 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 for instance with vm_state building and task_state spawning.
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:39 user nova-compute[74721]: WARNING nova.compute.manager [req-33d80465-7686-4f9b-a1b2-588e41adc4f0 req-66a53169-b29f-4dd7-b100-1fc5e632a1e8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa for instance with vm_state building and task_state spawning.
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-b1bb1ea2-963a-4838-acb6-b7108e20380a req-6ab3b0e6-108e-4fdc-a7ac-a3670bb55e54 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:40 user nova-compute[74721]: WARNING nova.compute.manager [req-3b3ebcd2-8215-49fe-b1ca-80afefdd708d req-ec5d639f-5d93-4675-af18-78c0cdea136f service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a for instance with vm_state building and task_state spawning.
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:59:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance spawned successfully.
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: INFO nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Took 9.85 seconds to spawn the instance on the hypervisor.
Nov 02 22:59:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:59:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:41 user nova-compute[74721]: INFO nova.compute.manager [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Took 10.82 seconds to build instance.
Nov 02 22:59:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-912a2e69-c315-4924-8fe8-2347024db009 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.930s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 22:59:42 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance spawned successfully.
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 22:59:42 user nova-compute[74721]: INFO nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Took 14.65 seconds to spawn the instance on the hypervisor.
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:42 user nova-compute[74721]: WARNING nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 for instance with vm_state building and task_state spawning.
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 22:59:42 user nova-compute[74721]: WARNING nova.compute.manager [req-17dd981c-3c14-46c0-af11-bddbb359ceb5 req-53ef638b-46b0-4946-be20-9661ec7c99e0 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 for instance with vm_state building and task_state spawning.
Nov 02 22:59:42 user nova-compute[74721]: INFO nova.compute.manager [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Took 122.41 seconds to build instance.
Nov 02 22:59:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c6deffd0-fe8a-46fb-a8c0-642cafca2d2b tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 122.514s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 22:59:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:54 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 is timed out.
Nov 02 22:59:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully detached device vdb from instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 from the live domain config.
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApcxZkVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:54 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1985a2-719f-4b84-9f4f-b3ccdb8e649f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 22:59:54 user nova-compute[74721]: No targets found.
Nov 02 22:59:54 user nova-compute[74721]: iSNS:
Nov 02 22:59:54 user nova-compute[74721]: No targets found.
Nov 02 22:59:54 user nova-compute[74721]: STATIC:
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 22:59:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:54 user nova-compute[74721]: FIRMWARE:
Nov 02 22:59:54 user nova-compute[74721]: No targets found.
Nov 02 22:59:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 22:59:54 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 22:59:54 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f2206-03b0-4541-ba9b-b53398077242]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07932c6-5095-4225-9ca4-4b681446cb89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:54 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243b0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[208809c5-b689-49d0-873a-bf50d6b5650b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d70127-8db9-4905-9e09-b7e075e431d6]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c8000-0e6b-4572-b2cd-2f51367dbacd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5537fe14-7ef5-4bf7-8d5f-71747baec41f]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d76f8-c4ec-48a6-91e8-148df3b93f44]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[12592937-c8bd-421f-9031-7c757481d28a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260]
Nov 02 22:59:54 user nova-compute[74721]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c8fe50-cca3-4579-b2a3-cb04a253b61c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2ac87-8789-4259-ad25-2adc02f0d73c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] <== disconnect_volume: return (426ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f43656cf-1127-4027-8af0-4ad3e475e8ee tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 107.657s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-7bd58e7a-a985-491b-a177-010b59bd0f34 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 107.559s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:54 user nova-compute[74721]: INFO nova.virt.block_device [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Attempting to driver detach volume 190e671b-2f9b-4d78-a662-12d2ef29ffa8 from mountpoint /dev/vdb
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Attempting to detach device vdb from instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 22:59:54 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:54 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 22:59:54 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:54 user nova-compute[74721]:   <serial>190e671b-2f9b-4d78-a662-12d2ef29ffa8</serial>
Nov 02 22:59:54 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 22:59:54 user nova-compute[74721]: </disk>
Nov 02 22:59:54 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 22:59:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Creating image(s)
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Ensure instance console log exists: /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Start _get_guest_xml network_info=[{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'b1c29595-e98e-445c-bf3c-d84921c09aea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJngoLTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '373a06ee-b138-4325-b1f5-99e52d5355ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'b588f0ac-6217-4a4b-8c20-ad426082ed54', 'serial': 'b588f0ac-6217-4a4b-8c20-ad426082ed54'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': 'e1e6b7ed-74a9-419b-a0cd-ee5c6e3df688', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCPUHFJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '373a06ee-b138-4325-b1f5-99e52d5355ad', 'attached_at': '', 'detached_at': '', 'volume_id': '6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 'serial': '6e338d1a-860e-479e-bf8b-f5d9e5ef04df'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': '050e3a57-5522-4e13-a16e-e583191f2535', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSmlhPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '373a06ee-b138-4325-b1f5-99e52d5355ad', 'attached_at': '', 'detached_at': '', 'volume_id': '85c05348-1b74-47b4-8a71-108a9256c3c0', 'serial': '85c05348-1b74-47b4-8a71-108a9256c3c0'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:59:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Successfully detached device vdb from instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 from the persistent domain config.
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 22:59:54 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:54 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 22:59:54 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 22:59:54 user nova-compute[74721]:   <serial>190e671b-2f9b-4d78-a662-12d2ef29ffa8</serial>
Nov 02 22:59:54 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 22:59:54 user nova-compute[74721]: </disk>
Nov 02 22:59:54 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 22:59:54 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:54 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJngoLTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:54 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:54 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:55 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff328b-bb79-42f1-a0c8-d07fadba8e77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:55 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0395b5-65e4-47ae-9521-64f1c7046c2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54] added
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20a91f-f8c3-4a15-9f9f-199ebe25e0ed]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[961ceb6b-d974-4913-be47-54e151f6be28]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJngoLTU {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJngoLTU" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81296fb5-59ce-4d4f-837b-3c5ff189d746]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJngoLTU'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f5a43-649f-4406-82c9-bd4ee04f8807]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a2f1a-83c4-4381-bd9f-92c577b3cb8a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b3f610-b7bb-41f6-a2e6-ab3dd4e48ba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260]
Nov 02 22:59:55 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[791164c3-adfe-4d8e-83da-be83777c18d8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a205b9-35ff-4a18-87cf-7ddfc3f2c18e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:55 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af205ab1-059d-4ab5-929f-a89059b2a5fa]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJngoLTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26430343235386263', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430343235386263', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCPUHFJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:56 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd43fd-c98e-445c-9999-1a538a268b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:56 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a7969-cabb-4b2a-9022-64fad6d1a300]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df] added
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[034c3f0b-d532-4b90-97a7-9b3a75bfedb0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[027dee89-1618-4c0e-8cc9-ee4372e029e7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCPUHFJO {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCPUHFJO" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b00c5-8f4b-48cd-8f1a-1d6798c3c376]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCPUHFJO'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efa0248-cd25-4e5e-95b3-60bea7772e85]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e48dbd-9666-4ed2-a211-617b379ac1a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e889c962-0c35-4ead-b4a1-4d1ab0815d13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260]
Nov 02 22:59:56 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eace5d75-d84d-4270-98e2-5afd75579807]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f866ab-7957-4b9c-b7bd-ffaf8ad25897]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:56 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c124ccab-18f2-4eca-8079-986827d4e441]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCPUHFJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'info_cache' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23433333266666332', 'path': '/dev/sdk'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433333266666332', 'path': '/dev/sdk'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSmlhPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:57 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:57 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:57 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f50395a-1b15-458f-9bab-702705a29fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:57 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd654c10-7a9e-45a1-a277-3b95b05e3443]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0] added
Nov 02 22:59:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d5623-381f-458c-baec-52ef46a4b691]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac8bb27-31e1-4eda-be0b-982891e2d215]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSmlhPrp {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSmlhPrp" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16734c0-bd18-4a53-a8b9-4211e6dff74e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSmlhPrp'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae53ae6a-42a1-4e1a-b66c-df14bd9807ee]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf85d3-cd56-48c0-8b40-90f5b7f6fb99]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed89657e-bbbc-4a17-9437-7d4cf54d8bd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260]
Nov 02 22:59:58 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13eb90-79a3-4532-8378-aa7b92b03aba]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5003fae-ebaf-42f1-b137-1b78d55d204a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:58 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e9d40-0fa2-463d-9d83-e32ada440074]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSmlhPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 22:59:58 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance destroyed successfully.
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'resources' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b517f6-e9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36b3ef74-7c21-4478-8680-38b4c1475402) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:58 user nova-compute[74721]: INFO os_vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 22:59:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:58 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26630373931633963', 'path': '/dev/sdl'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630373931633963', 'path': '/dev/sdl'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.420s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lazy-loading 'pci_devices' on Instance uuid 373a06ee-b138-4325-b1f5-99e52d5355ad {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1488f750-4e1a-4994-b930-676559af8efd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 22:59:59 user nova-compute[74721]: No targets found.
Nov 02 22:59:59 user nova-compute[74721]: iSNS:
Nov 02 22:59:59 user nova-compute[74721]: No targets found.
Nov 02 22:59:59 user nova-compute[74721]: STATIC:
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 22:59:59 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 22:59:59 user nova-compute[74721]:                 Iface Name: default
Nov 02 22:59:59 user nova-compute[74721]: FIRMWARE:
Nov 02 22:59:59 user nova-compute[74721]: No targets found.
Nov 02 22:59:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 22:59:59 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 22:59:59 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] End _get_guest_xml xml=<domain type="kvm">
Nov 02 22:59:59 user nova-compute[74721]:   <uuid>373a06ee-b138-4325-b1f5-99e52d5355ad</uuid>
Nov 02 22:59:59 user nova-compute[74721]:   <name>instance-0000000a</name>
Nov 02 22:59:59 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 22:59:59 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 22:59:59 user nova-compute[74721]:   <metadata>
Nov 02 22:59:59 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 22:59:59 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:name>tempest-device-tagging-server-656943302</nova:name>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:59:54</nova:creationTime>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 22:59:59 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 22:59:59 user nova-compute[74721]:       </nova:flavor>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:owner>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:user uuid="8e34182d4a774631bafacee47c987a09">tempest-TaggedBootDevicesTest_v242-1746374325-project-member</nova:user>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:project uuid="5fbdbbaa0b1c4805960775f6ffb5dcbb">tempest-TaggedBootDevicesTest_v242-1746374325</nova:project>
Nov 02 22:59:59 user nova-compute[74721]:       </nova:owner>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 22:59:59 user nova-compute[74721]:       <nova:ports>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="6c248aba-4058-4f40-ab25-4edccbffbac2">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="58222433-a0d5-462c-825e-803a15173831">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.185" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="3dfeee28-dee7-4b73-ad7a-73398fe62b77">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="a725e652-27f1-4b26-bbf7-3ae8d8b09e70">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="57bb8303-4cf0-4772-99e7-b9fa7d796e9f">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:         <nova:port uuid="919a774d-ae56-4e37-8e8e-afb72a999938">
Nov 02 22:59:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 22:59:59 user nova-compute[74721]:         </nova:port>
Nov 02 22:59:59 user nova-compute[74721]:       </nova:ports>
Nov 02 22:59:59 user nova-compute[74721]:     </nova:instance>
Nov 02 22:59:59 user nova-compute[74721]:   </metadata>
Nov 02 22:59:59 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 22:59:59 user nova-compute[74721]:     <system>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="serial">373a06ee-b138-4325-b1f5-99e52d5355ad</entry>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="uuid">373a06ee-b138-4325-b1f5-99e52d5355ad</entry>
Nov 02 22:59:59 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 22:59:59 user nova-compute[74721]:     </system>
Nov 02 22:59:59 user nova-compute[74721]:   </sysinfo>
Nov 02 22:59:59 user nova-compute[74721]:   <os>
Nov 02 22:59:59 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 22:59:59 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 22:59:59 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 22:59:59 user nova-compute[74721]:   </os>
Nov 02 22:59:59 user nova-compute[74721]:   <features>
Nov 02 22:59:59 user nova-compute[74721]:     <acpi/>
Nov 02 22:59:59 user nova-compute[74721]:     <apic/>
Nov 02 22:59:59 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 22:59:59 user nova-compute[74721]:   </features>
Nov 02 22:59:59 user nova-compute[74721]:   <clock offset="utc">
Nov 02 22:59:59 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 22:59:59 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 22:59:59 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 22:59:59 user nova-compute[74721]:   </clock>
Nov 02 22:59:59 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 22:59:59 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 22:59:59 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 22:59:59 user nova-compute[74721]:   </cpu>
Nov 02 22:59:59 user nova-compute[74721]:   <devices>
Nov 02 22:59:59 user nova-compute[74721]:     <disk type="file" device="cdrom">
Nov 02 22:59:59 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 22:59:59 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/disk.config"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="hda" bus="ide"/>
Nov 02 22:59:59 user nova-compute[74721]:     </disk>
Nov 02 22:59:59 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:59 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:59 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <serial>b588f0ac-6217-4a4b-8c20-ad426082ed54</serial>
Nov 02 22:59:59 user nova-compute[74721]:     </disk>
Nov 02 22:59:59 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:59 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:59 user nova-compute[74721]:       <source dev="/dev/sdk"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <serial>6e338d1a-860e-479e-bf8b-f5d9e5ef04df</serial>
Nov 02 22:59:59 user nova-compute[74721]:     </disk>
Nov 02 22:59:59 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 22:59:59 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 22:59:59 user nova-compute[74721]:       <source dev="/dev/sdl"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="vdc" bus="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <serial>85c05348-1b74-47b4-8a71-108a9256c3c0</serial>
Nov 02 22:59:59 user nova-compute[74721]:     </disk>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:fc:12:57"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap6c248aba-40"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:02:fd:51"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap58222433-a0"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:5a:a0:62"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap3dfeee28-de"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:fb:c8:bd"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tapa725e652-27"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:e6:2d:ad"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap57bb8303-4c"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:d6:68:83"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap1f7bc3ca-bf"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 22:59:59 user nova-compute[74721]:       <mac address="fa:16:3e:44:bb:bb"/>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 22:59:59 user nova-compute[74721]:       <target dev="tap919a774d-ae"/>
Nov 02 22:59:59 user nova-compute[74721]:     </interface>
Nov 02 22:59:59 user nova-compute[74721]:     <serial type="pty">
Nov 02 22:59:59 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/console.log" append="off"/>
Nov 02 22:59:59 user nova-compute[74721]:     </serial>
Nov 02 22:59:59 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 22:59:59 user nova-compute[74721]:     <video>
Nov 02 22:59:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 22:59:59 user nova-compute[74721]:     </video>
Nov 02 22:59:59 user nova-compute[74721]:     <rng model="virtio">
Nov 02 22:59:59 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 22:59:59 user nova-compute[74721]:     </rng>
Nov 02 22:59:59 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 22:59:59 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 22:59:59 user nova-compute[74721]:       <stats period="10"/>
Nov 02 22:59:59 user nova-compute[74721]:     </memballoon>
Nov 02 22:59:59 user nova-compute[74721]:   </devices>
Nov 02 22:59:59 user nova-compute[74721]: </domain>
Nov 02 22:59:59 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81885da7-f0e6-4f6b-b6fd-9eb146a34bb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2a01f93-34ec-53e1-a269-982d53999b10', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c248aba-40, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c248aba-40, col_values=(('qos', UUID('88b7064c-cd14-4a32-92fa-41b6be65058e')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c248aba-40, col_values=(('external_ids', {'iface-id': '6c248aba-4058-4f40-ab25-4edccbffbac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:12:57', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40')
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35088ed4-e96b-5ada-9c89-5dd0dc774615', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d57052f-1026-4544-a670-cd5124e3bb25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 22:59:59 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 22:59:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf4418eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58222433-a0, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58222433-a0, col_values=(('qos', UUID('7b5bc59c-9c66-4ddb-83d9-6b7aeed9643b')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58222433-a0, col_values=(('external_ids', {'iface-id': '58222433-a0d5-462c-825e-803a15173831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:fd:51', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf8db4-7a33-4228-8009-17699f4d3cd0]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0')
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c6c5fa4-65e2-557c-8b4f-8c682714bb57', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b18f1e-ba94-4e52-8876-568229bd0643]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fdfde1-899c-46b0-8514-6d94781fac0b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dfeee28-de, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dfeee28-de, col_values=(('qos', UUID('6a812f3b-7533-461f-a59d-97096abb3947')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dfeee28-de, col_values=(('external_ids', {'iface-id': '3dfeee28-dee7-4b73-ad7a-73398fe62b77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:a0:62', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[401bb76a-a80e-44a4-a3e2-062c5a6a5c72]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.compute.manager [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e', 'serial': 'daa25b40-8df3-47ca-a9e0-9edba355b26e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': '9854c732-f547-48c0-9e23-a2d38411b2b0', 'serial'} {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de')
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '398c87ad-85e7-511a-8ba0-101cb1a14143', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5af1d-5ee7-4c32-b003-8f4f4c774a83]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa725e652-27, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa725e652-27, col_values=(('qos', UUID('81f3a6ba-8042-4a62-907b-8f5c487c23ef')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa725e652-27, col_values=(('external_ids', {'iface-id': 'a725e652-27f1-4b26-bbf7-3ae8d8b09e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:c8:bd', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'flavor' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27')
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1439d47b-d925-5d34-8397-2b1ba9bc210c', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[34109eb7-f15b-47f5-9f00-2939407be6fb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]
Nov 02 22:59:59 user nova-compute[74721]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.
Nov 02 22:59:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57bb8303-4c, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57bb8303-4c, col_values=(('qos', UUID('bd41a1aa-e8b0-44e2-bfba-3cef314a9904')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57bb8303-4c, col_values=(('external_ids', {'iface-id': '57bb8303-4cf0-4772-99e7-b9fa7d796e9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:2d:ad', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f723fcc-d5a8-460a-bc1e-37f9545e93f8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== disconnect_volume: return (857ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.164s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start _get_guest_xml network_info=[{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '8d1c7c11-3e84-410d-8c9f-d86b4ed3f492', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '80e598d8-a24f-412f-a083-3de7b0b853b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'df05287d-23e4-46c6-8726-3dc1d326c8c6', 'serial': 'df05287d-23e4-46c6-8726-3dc1d326c8c6'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'numa_topology' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b6b023-3af9-4dad-ad43-2721c4c6eabb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 22:59:59 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c')
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b5bee-3303-460e-a033-40916d097162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '999877ec-1249-5638-8ed6-8122dfc296c6', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e] added
Nov 02 22:59:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 22:59:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[df73d9c3-0fae-4c5e-8d42-848be6a3d603]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 22:59:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a6dd85-c4e0-4000-b0d1-17a263fa367b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNaqmEds {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7bc3ca-bf, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7bc3ca-bf, col_values=(('qos', UUID('bbe6037c-aa54-4eee-8260-eda7b68ea7c0')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7bc3ca-bf, col_values=(('external_ids', {'iface-id': '1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:68:83', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 22:59:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNaqmEds" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9105f9d-0c8d-446a-ae1a-f59184c326f9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XNaqmEds'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba1ee5-e48f-4c17-b15f-a28802c0227b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf')
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc574f-0970-4671-b4f6-b2b2e171422e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '095add50-94d7-52d2-944e-b08d0eb06a07', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'flavor' on Instance uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap919a774d-ae, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap919a774d-ae, col_values=(('qos', UUID('b1a798c9-3b0e-4818-9d01-2f8b91f7f455')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap919a774d-ae, col_values=(('external_ids', {'iface-id': '919a774d-ae56-4e37-8e8e-afb72a999938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:bb:bb', 'vm-uuid': '373a06ee-b138-4325-b1f5-99e52d5355ad'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d91fc906-cb18-44c3-8f75-b86629255009 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.535s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd0890-bf74-4564-bc26-79c98a73e4ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260]
Nov 02 23:00:00 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.compute.manager [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Attaching volume 0d3e374a-a466-4f4f-90d5-8ca9f921cf71 to /dev/vdb
Nov 02 23:00:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033fad4-a128-438b-94aa-59e569efc678]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: INFO os_vif [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae')
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dace122-21a8-4c65-a704-860216493acf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:00 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] No BDM found with device name hda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] No VIF found with MAC fa:16:3e:fc:12:57, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] No VIF found with MAC fa:16:3e:e6:2d:ad, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Using config drive
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a3a62-90c9-4bf9-acee-8d7e3f7f612c]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ff1d0-5a02-46b8-afc8-aa816df3f837]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09c9d6-c0da-4819-a718-174654a3f911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d08f9-2b8f-4c5d-8ba7-cb037e93d970]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efb860-ff1d-40c6-8a2c-1b01acf7bda8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:00 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5933b433-474f-464a-80cd-b0d5d9096b18]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.utils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating existing volume attachment record: 90fdc39f-d061-45b1-b24d-26491509b194 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:00 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.compute.manager [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Detaching volume daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.virt.block_device [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Attempting to driver detach volume daf211a8-4e08-4a42-becc-c872dba78fe1 from mountpoint /dev/sdc
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Attempting to detach device sdc from instance 57e7fd79-796c-4531-bedd-969b531c343f from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:00 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:00 user nova-compute[74721]:   <source dev="/dev/sdj"/>
Nov 02 23:00:00 user nova-compute[74721]:   <target dev="sdc" bus="scsi"/>
Nov 02 23:00:00 user nova-compute[74721]:   <serial>daf211a8-4e08-4a42-becc-c872dba78fe1</serial>
Nov 02 23:00:00 user nova-compute[74721]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 23:00:00 user nova-compute[74721]: </disk>
Nov 02 23:00:00 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Successfully detached device sdc from instance 57e7fd79-796c-4531-bedd-969b531c343f from the persistent domain config.
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 57e7fd79-796c-4531-bedd-969b531c343f from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:00 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:00 user nova-compute[74721]:   <source dev="/dev/sdj"/>
Nov 02 23:00:00 user nova-compute[74721]:   <target dev="sdc" bus="scsi"/>
Nov 02 23:00:00 user nova-compute[74721]:   <serial>daf211a8-4e08-4a42-becc-c872dba78fe1</serial>
Nov 02 23:00:00 user nova-compute[74721]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 23:00:00 user nova-compute[74721]: </disk>
Nov 02 23:00:00 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:00 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Creating config drive at /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/disk.config
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi6qc1i50 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi6qc1i50" returned: 0 in 0.062s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:01 user nova-compute[74721]: INFO nova.compute.manager [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Detaching volume bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 23:00:01 user nova-compute[74721]: INFO nova.virt.block_device [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Attempting to driver detach volume bd916779-dd6b-40ae-aec7-060fbd9c393f from mountpoint /dev/vdb
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Attempting to detach device vdb from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:01 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:01 user nova-compute[74721]:   <source dev="/dev/sdi"/>
Nov 02 23:00:01 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:01 user nova-compute[74721]:   <serial>bd916779-dd6b-40ae-aec7-060fbd9c393f</serial>
Nov 02 23:00:01 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 23:00:01 user nova-compute[74721]: </disk>
Nov 02 23:00:01 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.557s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== connect_volume: return (1721ms) {'type': 'block', 'scsi_wwn': '23237636338396636', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237636338396636', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.404s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:01 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:01 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:00:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully detached device vdb from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the persistent domain config.
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:01 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:01 user nova-compute[74721]:   <source dev="/dev/sdi"/>
Nov 02 23:00:01 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:01 user nova-compute[74721]:   <serial>bd916779-dd6b-40ae-aec7-060fbd9c393f</serial>
Nov 02 23:00:01 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 23:00:01 user nova-compute[74721]: </disk>
Nov 02 23:00:01 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.objects.instance [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lazy-loading 'flavor' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3e919-b030-44ae-a49f-19625521de4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:00:01 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b5ec7e-6999-4ddd-9a21-1dd33a953a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6] added
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d4523-af88-413e-a78e-d05829e2b7c2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a2227-a897-4773-b514-c8685639b685]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYiCGjWf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYiCGjWf" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9e17c-fa18-41a9-a11f-1af27e8e3f61]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYiCGjWf'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e7d55-c7a7-4faf-b7ec-b27ca67eab5b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d57d9a-ffd7-4a0c-b19c-45054a9c8287]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[35653d65-7d5d-4825-80fb-c8b983ea8ac7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]
Nov 02 23:00:01 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c003b-8a7a-4420-9b44-7c92d10a1e34]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e62e04-bc56-4348-82ed-0a7b9cc00e0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:01 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18f44f0-ed5e-446c-8b01-d06dade35276]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== connect_volume: return (2881ms) {'type': 'block', 'scsi_wwn': '26233663166383536', 'path': '/dev/sdm'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233663166383536', 'path': '/dev/sdm'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.318s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:02 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:02 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[89670071-08f2-450a-9598-0a16633c985a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:00:02 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea7549-9386-45d6-abaa-5f274f0b2c87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551] added
Nov 02 23:00:02 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:00:03 user nova-compute[74721]:   <uuid>80e598d8-a24f-412f-a083-3de7b0b853b3</uuid>
Nov 02 23:00:03 user nova-compute[74721]:   <name>instance-00000003</name>
Nov 02 23:00:03 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:00:03 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:00:03 user nova-compute[74721]:   <metadata>
Nov 02 23:00:03 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:03 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeTestJSON-server-758223653</nova:name>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:creationTime>2023-11-02 22:59:59</nova:creationTime>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:00:03 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:03 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:owner>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:user uuid="6ce9460acd644a25a9c32ade02941243">tempest-AttachVolumeTestJSON-1894655503-project-member</nova:user>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:project uuid="bca4498dfb724e13ba1086d4e687d1ef">tempest-AttachVolumeTestJSON-1894655503</nova:project>
Nov 02 23:00:03 user nova-compute[74721]:       </nova:owner>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:03 user nova-compute[74721]:       <nova:ports>
Nov 02 23:00:03 user nova-compute[74721]:         <nova:port uuid="d0b517f6-e930-4e60-8193-2aa28648ac45">
Nov 02 23:00:03 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:00:03 user nova-compute[74721]:         </nova:port>
Nov 02 23:00:03 user nova-compute[74721]:       </nova:ports>
Nov 02 23:00:03 user nova-compute[74721]:     </nova:instance>
Nov 02 23:00:03 user nova-compute[74721]:   </metadata>
Nov 02 23:00:03 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:00:03 user nova-compute[74721]:     <system>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="serial">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="uuid">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 23:00:03 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:00:03 user nova-compute[74721]:     </system>
Nov 02 23:00:03 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:03 user nova-compute[74721]:   <os>
Nov 02 23:00:03 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:00:03 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:00:03 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:00:03 user nova-compute[74721]:   </os>
Nov 02 23:00:03 user nova-compute[74721]:   <features>
Nov 02 23:00:03 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:03 user nova-compute[74721]:     <apic/>
Nov 02 23:00:03 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:00:03 user nova-compute[74721]:   </features>
Nov 02 23:00:03 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:00:03 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:00:03 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:00:03 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:00:03 user nova-compute[74721]:   </clock>
Nov 02 23:00:03 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:00:03 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:00:03 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:00:03 user nova-compute[74721]:   </cpu>
Nov 02 23:00:03 user nova-compute[74721]:   <devices>
Nov 02 23:00:03 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:00:03 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:00:03 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk"/>
Nov 02 23:00:03 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:00:03 user nova-compute[74721]:     </disk>
Nov 02 23:00:03 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:00:03 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:03 user nova-compute[74721]:       <source dev="/dev/sdm"/>
Nov 02 23:00:03 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:00:03 user nova-compute[74721]:       <serial>df05287d-23e4-46c6-8726-3dc1d326c8c6</serial>
Nov 02 23:00:03 user nova-compute[74721]:     </disk>
Nov 02 23:00:03 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:00:03 user nova-compute[74721]:       <mac address="fa:16:3e:ce:ca:8f"/>
Nov 02 23:00:03 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:03 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:00:03 user nova-compute[74721]:       <target dev="tapd0b517f6-e9"/>
Nov 02 23:00:03 user nova-compute[74721]:     </interface>
Nov 02 23:00:03 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:00:03 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/console.log" append="off"/>
Nov 02 23:00:03 user nova-compute[74721]:     </serial>
Nov 02 23:00:03 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:00:03 user nova-compute[74721]:     <video>
Nov 02 23:00:03 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:03 user nova-compute[74721]:     </video>
Nov 02 23:00:03 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:00:03 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:00:03 user nova-compute[74721]:     </rng>
Nov 02 23:00:03 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:00:03 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:00:03 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:00:03 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:03 user nova-compute[74721]:   </devices>
Nov 02 23:00:03 user nova-compute[74721]: </domain>
Nov 02 23:00:03 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194e7fb-cea7-4402-8875-2474708d0f14]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe31f3-b857-4c0e-97c3-526172c8232c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiKuYkdR {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiKuYkdR" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a313eb75-909d-48e9-95df-5ab9b42daec0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OiKuYkdR'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43484a-ce6e-4efa-b3ea-ec7ffd98989c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf6fd4-f630-4813-8572-1be63e31264f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --login" returned: 0 in 0.182s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[50136689-1325-4c66-99fd-8a642b9c4b86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260]
Nov 02 23:00:03 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57f8ed-c9c1-4030-9837-297995cbe3c0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fe962-f4f0-4c18-8030-efca62725f26]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:03 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.714s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] HCTL ('45', '-', '-', 0) found on session 16 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Scanning host 45 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host45/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host45/scan" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c6d2b-39ed-435c-b64b-23cfe834029f]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching for a device in session 16 and hctl ['45', '*', '*', 0] yield: sdn {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Connected to sdn using {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.395s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:04 user nova-compute[74721]: WARNING nova.compute.manager [req-7a3483f0-c6b5-4e0f-96df-c40c8a606041 req-c1cd361c-0d91-449c-aab8-f6c73aedca17 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 for instance with vm_state building and task_state spawning.
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.385s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Cannot resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'migration_context' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.objects.base [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG os_vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f618c7e9-f9a9-5b1d-90ca-bd8341b2a0c4', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b517f6-e9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b517f6-e9, col_values=(('qos', UUID('662405e0-1af3-4094-8a13-ffdb036aa7ec')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b517f6-e9, col_values=(('external_ids', {'iface-id': 'd0b517f6-e930-4e60-8193-2aa28648ac45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ca:8f', 'vm-uuid': '80e598d8-a24f-412f-a083-3de7b0b853b3'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.900s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] <== connect_volume: return (4218ms) {'type': 'block', 'scsi_wwn': '23531643431396531', 'path': '/dev/sdn'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643431396531', 'path': '/dev/sdn'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'flavor' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 462422016 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: INFO os_vif [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:00:04 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:04 user nova-compute[74721]:   <source dev="/dev/sdn"/>
Nov 02 23:00:04 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:04 user nova-compute[74721]:   <serial>b98da9af-12db-4295-87d7-fbd1b0314551</serial>
Nov 02 23:00:04 user nova-compute[74721]: </disk>
Nov 02 23:00:04 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:00:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No VIF found with MAC fa:16:3e:cc:97:7f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:05 user nova-compute[74721]: WARNING nova.compute.manager [req-c5d68296-ff7a-4632-9dc5-eafd8d58c966 req-6ee7dd7c-4dee-4d30-97ed-3d2355f4c317 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 for instance with vm_state building and task_state spawning.
Nov 02 23:00:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 649068544 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-35a4d310-b1d2-4e1b-9a2f-cf42b7c19dfb tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.498s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 791674880 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:06 user nova-compute[74721]: WARNING nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 for instance with vm_state building and task_state spawning.
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:06 user nova-compute[74721]: WARNING nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 for instance with vm_state building and task_state spawning.
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:06 user nova-compute[74721]: WARNING nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 for instance with vm_state building and task_state spawning.
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:06 user nova-compute[74721]: WARNING nova.compute.manager [req-7593673a-fc19-4fdb-9d9b-2718aa1b1abc req-22cf6754-2ab5-4230-9772-957ffe67ed3a service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 for instance with vm_state building and task_state spawning.
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:06 user nova-compute[74721]: WARNING nova.compute.manager [req-f8abfcf4-416b-41b3-96fe-006af4191980 req-b751ac49-6256-4a6d-b052-d196fbd069fe service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f for instance with vm_state building and task_state spawning.
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 964689920 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: INFO nova.compute.manager [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Rescuing
Nov 02 23:00:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:07 user nova-compute[74721]: WARNING nova.compute.manager [req-2f00a034-1c0d-4414-b4c3-b2974a36d8ca req-acadbefe-8839-4b9b-9388-0ac0a65b40a6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 for instance with vm_state building and task_state spawning.
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:08 user nova-compute[74721]: WARNING nova.compute.manager [req-4b0badb4-d985-40dc-ad9f-5522ad8638b3 req-32b382a0-1441-4fb9-aad1-762989be879b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 for instance with vm_state building and task_state spawning.
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:09 user nova-compute[74721]: WARNING nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f for instance with vm_state building and task_state spawning.
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:09 user nova-compute[74721]: WARNING nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf for instance with vm_state building and task_state spawning.
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:09 user nova-compute[74721]: WARNING nova.compute.manager [req-d8015838-368c-4ccf-a738-d10d573859eb req-9dd70895-3235-4036-a092-be76fdf62dd2 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf for instance with vm_state building and task_state spawning.
Nov 02 23:00:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:09 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf7e63-42ec-473d-9c64-03e71bc9b50c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:09 user nova-compute[74721]: No targets found.
Nov 02 23:00:09 user nova-compute[74721]: iSNS:
Nov 02 23:00:09 user nova-compute[74721]: No targets found.
Nov 02 23:00:09 user nova-compute[74721]: STATIC:
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:09 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:09 user nova-compute[74721]: No targets found.
Nov 02 23:00:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:09 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:09 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab3b91-1ebe-4135-9efc-447a0bc17ce6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70933af6-69a8-491b-b815-b7f5c0dab1ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:09 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf4b83a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[683a7572-1cbe-4f13-bf1e-48575749e602]: (4, ('path checker states:\nup                  13\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b6265-0d98-4ce9-8f3e-ee9e0f00b68a]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd65595-d2f8-4c7d-b732-a5aa49115c51]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7a2f2-0acc-4a2a-9150-aae748a83257]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea9f0e1-7c94-478d-96ef-d9372b2375dc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance destroyed successfully.
Nov 02 23:00:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attempting a stable device rescue
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af7149-56d0-45af-94f8-e2cdbc07f566]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]
Nov 02 23:00:09 user nova-compute[74721]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:00:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Creating image(s)
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a5148-505b-445c-83a2-4a0804a1c16f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== disconnect_volume: return (487ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e', 'serial'} {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 02 23:00:09 user nova-compute[74721]: DEBUG nova.compute.manager [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: removing Cinder connection for volume 9854c732-f547-48c0-9e23-a2d38411b2b0 {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 for instance with vm_state building and task_state spawning.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 for instance with vm_state building and task_state spawning.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state powering-on.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-837499b2-9390-4fa2-928d-21ca968910db req-f910a354-129b-466d-866e-fa2eee29c0f8 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state powering-on.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state rescuing.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:10 user nova-compute[74721]: WARNING nova.compute.manager [req-6e92a978-3c1f-4597-88df-5ea73d665adc req-e5e6252b-4e1e-42aa-966d-ac9fb4934a66 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state rescuing.
Nov 02 23:00:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.part --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.virt.images [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] 21a62824-7b55-4abb-85bd-10732f7f8a02 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.part /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: Updating volume 9854c732-f547-48c0-9e23-a2d38411b2b0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XNaqmEds", "auth_password": "iswbCBL7cYrSG8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "daa25b40-8df3-47ca-a9e0-9edba355b26e"}, "status": "reserved", "instance": "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc", "attached_at": "", "detached_at": "", "volume_id": "daa25b40-8df3-47ca-a9e0-9edba355b26e", "serial": "daa25b40-8df3-47ca-a9e0-9edba355b26e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e', 'no_device': None, 'attachment_id': 'fa485240-a1f0-4fdc-afa9-8a992f6ce6df'} {{(pid=74721) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-170923dc-8afb-4002-b8f2-e68731237a4b tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 38.270s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.part /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.converted" returned: 0 in 0.277s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.706s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79 --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79,backing_fmt=raw /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79,backing_fmt=raw /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue" returned: 0 in 0.053s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "283c967ef7e71a928f1a8d119be2c1e208e12a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'migration_context' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Object Instance<2bd27de5-1593-4d0e-981a-766ca5bc052a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start _get_guest_xml network_info=[{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "vif_mac": "fa:16:3e:cc:97:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '21a62824-7b55-4abb-85bd-10732f7f8a02', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': 'e3d0d173-27e1-4e6f-a94b-100c06533fde', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdn'}, 'status': 'reserved', 'instance': '2bd27de5-1593-4d0e-981a-766ca5bc052a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b98da9af-12db-4295-87d7-fbd1b0314551', 'serial': 'b98da9af-12db-4295-87d7-fbd1b0314551'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'resources' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Object Instance<2bd27de5-1593-4d0e-981a-766ca5bc052a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Object Instance<2bd27de5-1593-4d0e-981a-766ca5bc052a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.objects.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Object Instance<2bd27de5-1593-4d0e-981a-766ca5bc052a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:11 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:11 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:11 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance rebooted successfully.
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-44884d9c-4dee-4f64-9bb6-83b0fb960ee3 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c631fb-14b1-427b-b296-59f6e7488d45]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OiKuYkdR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 23:00:11 user nova-compute[74721]: node.name = iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:11 user nova-compute[74721]: node.tpgt = -1
Nov 02 23:00:11 user nova-compute[74721]: node.startup = automatic
Nov 02 23:00:11 user nova-compute[74721]: node.leading_login = No
Nov 02 23:00:11 user nova-compute[74721]: iface.iscsi_ifacename = default
Nov 02 23:00:11 user nova-compute[74721]: iface.net_ifacename = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.ipaddress = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.prefix_len = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.hwaddress = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.transport_name = tcp
Nov 02 23:00:11 user nova-compute[74721]: iface.initiatorname = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.vlan_id = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.vlan_priority = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.vlan_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.iface_num = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.mtu = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.port = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.bootproto = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.subnet_mask = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.gateway = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_alt_client_id = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_dns = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_learn_iqn = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_vendor_id_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_vendor_id = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.dhcp_slp_da = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.fragmentation = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.gratuitous_arp = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.incoming_forwarding = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.tos_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.tos = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.ttl = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.delayed_ack = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.tcp_nagle = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.tcp_wsf_state = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.tcp_wsf = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.tcp_timer_scale = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.tcp_timestamp = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.redirect = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.def_task_mgmt_timeout = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.header_digest = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.data_digest = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.immediate_data = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.initial_r2t = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.data_seq_inorder = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.data_pdu_inorder = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.erl = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.max_receive_data_len = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.first_burst_len = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.max_outstanding_r2t = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.max_burst_len = 0
Nov 02 23:00:11 user nova-compute[74721]: iface.chap_auth = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.bidi_chap = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.strict_login_compliance = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.discovery_auth = <empty>
Nov 02 23:00:11 user nova-compute[74721]: iface.discovery_logout = <empty>
Nov 02 23:00:11 user nova-compute[74721]: node.discovery_address = <empty>
Nov 02 23:00:11 user nova-compute[74721]: node.discovery_port = 0
Nov 02 23:00:11 user nova-compute[74721]: node.discovery_type = static
Nov 02 23:00:11 user nova-compute[74721]: node.session.initial_cmdsn = 0
Nov 02 23:00:11 user nova-compute[74721]: node.session.initial_login_retry_max = 8
Nov 02 23:00:11 user nova-compute[74721]: node.session.xmit_thread_priority = -20
Nov 02 23:00:11 user nova-compute[74721]: node.session.cmds_max = 128
Nov 02 23:00:11 user nova-compute[74721]: node.session.queue_depth = 32
Nov 02 23:00:11 user nova-compute[74721]: node.session.nr_sessions = 1
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.authmethod = CHAP
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.username = OiKuYkdR
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.password = ***
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.username_in = <empty>
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.password_in = <empty>
Nov 02 23:00:11 user nova-compute[74721]: node.session.auth.chap_algs = MD5
Nov 02 23:00:11 user nova-compute[74721]: node.session.timeo.replacement_timeout = 120
Nov 02 23:00:11 user nova-compute[74721]: node.session.err_timeo.abort_timeout = 15
Nov 02 23:00:11 user nova-compute[74721]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 23:00:11 user nova-compute[74721]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 23:00:11 user nova-compute[74721]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.FastAbort = Yes
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.InitialR2T = No
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.ImmediateData = Yes
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.MaxConnections = 1
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 23:00:11 user nova-compute[74721]: node.session.iscsi.ERL = 0
Nov 02 23:00:11 user nova-compute[74721]: node.session.scan = manual
Nov 02 23:00:11 user nova-compute[74721]: node.session.reopen_max = 0
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].address = 172.16.0.220
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].port = 3260
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].startup = manual
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].tcp.window_size = 524288
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].tcp.type_of_service = 0
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].timeo.logout_timeout = 15
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].timeo.login_timeout = 15
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].timeo.auth_timeout = 45
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.DataDigest = None
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.IFMarker = No
Nov 02 23:00:11 user nova-compute[74721]: node.conn[0].iscsi.OFMarker = No
Nov 02 23:00:11 user nova-compute[74721]: # END RECORD
Nov 02 23:00:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad80f3-508c-43df-9e9d-ce31c80bc982]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7100743c-c4aa-4ffb-afd3-3c903c454929]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiKuYkdR {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiKuYkdR" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a92c10-cf3a-497d-9083-0f7d2817320d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OiKuYkdR'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance spawned successfully.
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f4e5c-7142-4e25-b673-05a36dba6881]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c452773-340d-4999-b112-148847677fd3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:11 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.205s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] HCTL ('45', '0', '0', 0) found on session 16 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Scanning host 45 c: 0, t: 0, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host45/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host45/scan" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38da5f1-7c6f-46e9-b806-e2a988bc1e7a]: (4, ('0 0 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Searching for a device in session 16 and hctl ('45', '0', '0', 0) yield: sdn {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Connected to sdn using {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.233s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '23531643431396531', 'path': '/dev/sdn'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643431396531', 'path': '/dev/sdn'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:12 user nova-compute[74721]: INFO nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Took 17.11 seconds to spawn the instance on the hypervisor.
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1030411833',display_name='tempest-ServerStableDeviceRescueTest-server-1030411833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1030411833',id=1,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNIZDD8fSNOHfbgmvPWgQYpuaaFUt9Y9aHT0Ls1/1zORqHXG2VLjhoJgSljiBLih0CzZJOocC8cPPiKkVNHaXqEfB8yvxOL1648swx/iSRx+hKVxo6dqgFdibBckJG9aQ==',key_name='tempest-keypair-593836985',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d1f14597a747e7861bd5804f741326',ramdisk_id='',reservation_id='r-a3o4h2d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1520146931',owner_user_name='tempest-ServerStableDeviceRescueTest-1520146931-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T22:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9bbcabb56f4e58b533c7249824bfc6',uuid=2bd27de5-1593-4d0e-981a-766ca5bc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "vif_mac": "fa:16:3e:cc:97:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converting VIF {"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "vif_mac": "fa:16:3e:cc:97:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.objects.base [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Object Instance<2bd27de5-1593-4d0e-981a-766ca5bc052a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:00:12 user nova-compute[74721]:   <uuid>2bd27de5-1593-4d0e-981a-766ca5bc052a</uuid>
Nov 02 23:00:12 user nova-compute[74721]:   <name>instance-00000001</name>
Nov 02 23:00:12 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:00:12 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:00:12 user nova-compute[74721]:   <metadata>
Nov 02 23:00:12 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:12 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1030411833</nova:name>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:00:11</nova:creationTime>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:00:12 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:12 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:owner>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:user uuid="8c9bbcabb56f4e58b533c7249824bfc6">tempest-ServerStableDeviceRescueTest-1520146931-project-member</nova:user>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:project uuid="17d1f14597a747e7861bd5804f741326">tempest-ServerStableDeviceRescueTest-1520146931</nova:project>
Nov 02 23:00:12 user nova-compute[74721]:       </nova:owner>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:12 user nova-compute[74721]:       <nova:ports>
Nov 02 23:00:12 user nova-compute[74721]:         <nova:port uuid="1d4d3068-1dfb-4c8f-9162-2d807dc11302">
Nov 02 23:00:12 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:00:12 user nova-compute[74721]:         </nova:port>
Nov 02 23:00:12 user nova-compute[74721]:       </nova:ports>
Nov 02 23:00:12 user nova-compute[74721]:     </nova:instance>
Nov 02 23:00:12 user nova-compute[74721]:   </metadata>
Nov 02 23:00:12 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:00:12 user nova-compute[74721]:     <system>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="serial">2bd27de5-1593-4d0e-981a-766ca5bc052a</entry>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="uuid">2bd27de5-1593-4d0e-981a-766ca5bc052a</entry>
Nov 02 23:00:12 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:00:12 user nova-compute[74721]:     </system>
Nov 02 23:00:12 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:12 user nova-compute[74721]:   <os>
Nov 02 23:00:12 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:00:12 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:00:12 user nova-compute[74721]:   </os>
Nov 02 23:00:12 user nova-compute[74721]:   <features>
Nov 02 23:00:12 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:12 user nova-compute[74721]:     <apic/>
Nov 02 23:00:12 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:00:12 user nova-compute[74721]:   </features>
Nov 02 23:00:12 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:00:12 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:00:12 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:00:12 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:00:12 user nova-compute[74721]:   </clock>
Nov 02 23:00:12 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:00:12 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:00:12 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:00:12 user nova-compute[74721]:   </cpu>
Nov 02 23:00:12 user nova-compute[74721]:   <devices>
Nov 02 23:00:12 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:00:12 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:00:12 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk"/>
Nov 02 23:00:12 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:00:12 user nova-compute[74721]:     </disk>
Nov 02 23:00:12 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:00:12 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:12 user nova-compute[74721]:       <source dev="/dev/sdn"/>
Nov 02 23:00:12 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:00:12 user nova-compute[74721]:       <serial>b98da9af-12db-4295-87d7-fbd1b0314551</serial>
Nov 02 23:00:12 user nova-compute[74721]:     </disk>
Nov 02 23:00:12 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:00:12 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:00:12 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue"/>
Nov 02 23:00:12 user nova-compute[74721]:       <target dev="vdc" bus="virtio"/>
Nov 02 23:00:12 user nova-compute[74721]:       <boot order="1"/>
Nov 02 23:00:12 user nova-compute[74721]:     </disk>
Nov 02 23:00:12 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:00:12 user nova-compute[74721]:       <mac address="fa:16:3e:cc:97:7f"/>
Nov 02 23:00:12 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:12 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:00:12 user nova-compute[74721]:       <target dev="tap1d4d3068-1d"/>
Nov 02 23:00:12 user nova-compute[74721]:     </interface>
Nov 02 23:00:12 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:00:12 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/console.log" append="off"/>
Nov 02 23:00:12 user nova-compute[74721]:     </serial>
Nov 02 23:00:12 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:00:12 user nova-compute[74721]:     <video>
Nov 02 23:00:12 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:12 user nova-compute[74721]:     </video>
Nov 02 23:00:12 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:00:12 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:00:12 user nova-compute[74721]:     </rng>
Nov 02 23:00:12 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:00:12 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:00:12 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:00:12 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:12 user nova-compute[74721]:   </devices>
Nov 02 23:00:12 user nova-compute[74721]: </domain>
Nov 02 23:00:12 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:00:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance destroyed successfully.
Nov 02 23:00:12 user nova-compute[74721]: INFO nova.compute.manager [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Took 170.12 seconds to build instance.
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] No VIF found with MAC fa:16:3e:cc:97:7f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b64da383-bc72-4350-8d0f-3343cc437b75 tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 170.233s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5396a5-8422-4c50-9f25-dcb6b4d382b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c257a-d8aa-4ed7-8db7-cbd61530d599]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6526d0-eebc-404e-86bd-7311f8b3fe34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691b5d2-0cff-4d5d-861b-a9b0fbc3edb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:12 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:00:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0834e2-175b-4cf9-94ac-5a94c84f59ea]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:00:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:12 user nova-compute[74721]: INFO nova.compute.manager [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Swapping volume daa25b40-8df3-47ca-a9e0-9edba355b26e for 9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 23:00:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:14 user nova-compute[74721]: WARNING nova.compute.manager [req-11b8356e-7da8-42a0-a842-c809438fa66f req-f734a267-a7bd-4c55-aa6f-8848f4ce0a8f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state rescuing.
Nov 02 23:00:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:15 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 is timed out.
Nov 02 23:00:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Successfully detached device vdb from instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 from the live domain config.
Nov 02 23:00:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcnaMxDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:15 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb07f3-6b0e-49d9-91cc-37ab1abad00e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:15 user nova-compute[74721]: No targets found.
Nov 02 23:00:15 user nova-compute[74721]: iSNS:
Nov 02 23:00:15 user nova-compute[74721]: No targets found.
Nov 02 23:00:15 user nova-compute[74721]: STATIC:
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:15 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:15 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:15 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:15 user nova-compute[74721]: No targets found.
Nov 02 23:00:15 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:15 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:15 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f809bc-2b96-46c4-89bd-6473ab3daf51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f7784-0f7e-4f36-8212-9b67a556f39f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:15 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:15 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:15 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2466cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c54259-8f35-43b4-a0c2-414b56636869]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79d1b4-b395-4c66-9801-40aac853b1fc]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e305d9-2ac1-4798-8e85-eee5f9f4b6fd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222ea0d-80ce-4961-af22-2954d95a3b03]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c644aaf-ca00-4b19-aa73-1a2175937770]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e7928-173f-4beb-b862-b2eb5c1c55c1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260]
Nov 02 23:00:15 user nova-compute[74721]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:15 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:190e671b-2f9b-4d78-a662-12d2ef29ffa8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19ef4af-427e-462e-a1a2-19644e0434f7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] <== disconnect_volume: return (449ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:16 user nova-compute[74721]: WARNING nova.compute.manager [req-4d47cb60-b292-417e-91c2-f22eb3466328 req-d17b0753-6fde-4c2f-a0e6-8736f61d77c1 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state rescuing.
Nov 02 23:00:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-8a898d7e-b558-44cc-ad80-9dcb92a9717f tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:00:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lazy-loading 'flavor' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-48c86725-3579-4a2d-9fa9-8316c47d52e0 tempest-VolumesAssistedSnapshotsTest-282391040 tempest-VolumesAssistedSnapshotsTest-282391040-project-admin] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 43.364s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:21 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 57e7fd79-796c-4531-bedd-969b531c343f is timed out.
Nov 02 23:00:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Successfully detached device sdc from instance 57e7fd79-796c-4531-bedd-969b531c343f from the live domain config.
Nov 02 23:00:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lacUOwLF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:21 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d257143-0e5c-49c6-9a87-79595adb8d1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]: iSNS:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]: STATIC:
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:21 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:21 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4921e06c-10f4-4a52-8e44-6390b3f8d87f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131e4bf-2f4e-4ea8-acd2-8a7b93d1e29b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:21 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2466db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1'): ({'sdj'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Removing single pathed devices sdj {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50a122f-2c3c-429c-9870-1687359d2a4e]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4e4dd-71a9-4ecc-ae56-682a70accd9a]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Flushing IO for device /dev/sdj {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[05892009-b546-494b-87f3-f496355e22b3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce57f2-fff8-4b5d-a50d-4d99e8246e21]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] SCSI volumes sdj have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a233a-670b-4ac6-87c6-9ec71d789a8d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44057e-1cbb-4f21-b2ea-ad260f242759]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260]
Nov 02 23:00:21 user nova-compute[74721]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf211a8-4e08-4a42-becc-c872dba78fe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece0b34f-2e29-4f81-8782-851fac356ec8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] <== disconnect_volume: return (382ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:21 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 is timed out.
Nov 02 23:00:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully detached device vdb from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the live domain config.
Nov 02 23:00:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SACWtFBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:21 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b55986-8d5b-4bd2-a951-23fe526800b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]: iSNS:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]: STATIC:
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:21 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:21 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:21 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:21 user nova-compute[74721]: No targets found.
Nov 02 23:00:21 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:21 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:21 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16899107-147a-4afd-bbca-7af2c9eb9490]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9235f-2930-4394-97f4-6f693fd79fe3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:22 user nova-compute[74721]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f (non-flash)
Nov 02 23:00:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243b1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f'): ({'sdi'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Removing single pathed devices sdi {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dacea9-181d-4614-829d-85bff451b068]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e028c-911d-4855-a0f2-bc09a8d4ffa9]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Flushing IO for device /dev/sdi {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc23849e-6758-440d-968b-c35189a9ad8c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb68b12-640f-4053-9d57-6005f41f989a]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] SCSI volumes sdi have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dd3ac4-e058-4738-977c-a37081f08ae0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261ff6c-1dc4-4a68-9a02-e69c57a7e02d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260]
Nov 02 23:00:22 user nova-compute[74721]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd916779-dd6b-40ae-aec7-060fbd9c393f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6934820c-c4d0-41c8-9e85-3a2b45045d39]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] <== disconnect_volume: return (406ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lazy-loading 'flavor' on Instance uuid 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-427afcd7-ed6c-495d-b4d3-f2d5b70faef6 tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.141s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:23 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:23 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:00:23 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d1b13583-68ed-481e-9631-48e1861e8897 tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.755s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-a49f3161-72f9-4437-9d7c-a87d4c834918" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-a49f3161-72f9-4437-9d7c-a87d4c834918" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Attempting to detach device tapa49f3161-72 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] detach device xml: <interface type="ethernet">
Nov 02 23:00:24 user nova-compute[74721]:   <mac address="fa:16:3e:c2:d3:45"/>
Nov 02 23:00:24 user nova-compute[74721]:   <model type="virtio"/>
Nov 02 23:00:24 user nova-compute[74721]:   <mtu size="1442"/>
Nov 02 23:00:24 user nova-compute[74721]:   <target dev="tapa49f3161-72"/>
Nov 02 23:00:24 user nova-compute[74721]: </interface>
Nov 02 23:00:24 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 23:00:24 user nova-compute[74721]:   <name>instance-00000008</name>
Nov 02 23:00:24 user nova-compute[74721]:   <uuid>65971139-4ea2-4c05-b4ec-beb6e91bb571</uuid>
Nov 02 23:00:24 user nova-compute[74721]:   <metadata>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:24 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:creationTime>2023-11-02 22:58:05</nova:creationTime>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:24 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:24 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:24 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:24 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:24 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:24 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:24 user nova-compute[74721]:     <nova:port uuid="a49f3161-72f9-4437-9d7c-a87d4c834918">
Nov 02 23:00:24 user nova-compute[74721]:       <nova:ip type="fixed" address="10.10.10.47" ipVersion="4"/>
Nov 02 23:00:24 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:24 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:24 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:24 user nova-compute[74721]:   </metadata>
Nov 02 23:00:24 user nova-compute[74721]:   <memory unit='KiB'>524288</memory>
Nov 02 23:00:24 user nova-compute[74721]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 23:00:24 user nova-compute[74721]:   <vcpu placement='static'>1</vcpu>
Nov 02 23:00:24 user nova-compute[74721]:   <resource>
Nov 02 23:00:24 user nova-compute[74721]:     <partition>/machine</partition>
Nov 02 23:00:24 user nova-compute[74721]:   </resource>
Nov 02 23:00:24 user nova-compute[74721]:   <sysinfo type='smbios'>
Nov 02 23:00:24 user nova-compute[74721]:     <system>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='version'>0.0.0</entry>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='serial'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='uuid'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:24 user nova-compute[74721]:       <entry name='family'>Virtual Machine</entry>
Nov 02 23:00:24 user nova-compute[74721]:     </system>
Nov 02 23:00:24 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:24 user nova-compute[74721]:   <os>
Nov 02 23:00:24 user nova-compute[74721]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 23:00:24 user nova-compute[74721]:     <boot dev='hd'/>
Nov 02 23:00:24 user nova-compute[74721]:     <smbios mode='sysinfo'/>
Nov 02 23:00:24 user nova-compute[74721]:   </os>
Nov 02 23:00:24 user nova-compute[74721]:   <features>
Nov 02 23:00:24 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:24 user nova-compute[74721]:     <apic/>
Nov 02 23:00:24 user nova-compute[74721]:     <vmcoreinfo state='on'/>
Nov 02 23:00:24 user nova-compute[74721]:   </features>
Nov 02 23:00:24 user nova-compute[74721]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 23:00:24 user nova-compute[74721]:     <model fallback='forbid'>Nehalem</model>
Nov 02 23:00:24 user nova-compute[74721]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 23:00:24 user nova-compute[74721]:     <feature policy='require' name='vme'/>
Nov 02 23:00:24 user nova-compute[74721]:     <feature policy='require' name='x2apic'/>
Nov 02 23:00:24 user nova-compute[74721]:     <feature policy='require' name='hypervisor'/>
Nov 02 23:00:24 user nova-compute[74721]:   </cpu>
Nov 02 23:00:24 user nova-compute[74721]:   <clock offset='utc'>
Nov 02 23:00:24 user nova-compute[74721]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 23:00:24 user nova-compute[74721]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 23:00:24 user nova-compute[74721]:     <timer name='hpet' present='no'/>
Nov 02 23:00:24 user nova-compute[74721]:   </clock>
Nov 02 23:00:24 user nova-compute[74721]:   <on_poweroff>destroy</on_poweroff>
Nov 02 23:00:24 user nova-compute[74721]:   <on_reboot>restart</on_reboot>
Nov 02 23:00:24 user nova-compute[74721]:   <on_crash>destroy</on_crash>
Nov 02 23:00:24 user nova-compute[74721]:   <devices>
Nov 02 23:00:24 user nova-compute[74721]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 23:00:24 user nova-compute[74721]:     <disk type='file' device='disk'>
Nov 02 23:00:24 user nova-compute[74721]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 23:00:24 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk' index='2'/>
Nov 02 23:00:24 user nova-compute[74721]:       <backingStore type='file' index='3'>
Nov 02 23:00:24 user nova-compute[74721]:         <format type='raw'/>
Nov 02 23:00:24 user nova-compute[74721]:         <source file='/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e'/>
Nov 02 23:00:24 user nova-compute[74721]:         <backingStore/>
Nov 02 23:00:24 user nova-compute[74721]:       </backingStore>
Nov 02 23:00:24 user nova-compute[74721]:       <target dev='vda' bus='virtio'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='virtio-disk0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </disk>
Nov 02 23:00:24 user nova-compute[74721]:     <disk type='file' device='cdrom'>
Nov 02 23:00:24 user nova-compute[74721]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 23:00:24 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config' index='1'/>
Nov 02 23:00:24 user nova-compute[74721]:       <backingStore/>
Nov 02 23:00:24 user nova-compute[74721]:       <target dev='hda' bus='ide'/>
Nov 02 23:00:24 user nova-compute[74721]:       <readonly/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='ide0-0-0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </disk>
Nov 02 23:00:24 user nova-compute[74721]:     <controller type='usb' index='0' model='none'>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='usb'/>
Nov 02 23:00:24 user nova-compute[74721]:     </controller>
Nov 02 23:00:24 user nova-compute[74721]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='pci.0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </controller>
Nov 02 23:00:24 user nova-compute[74721]:     <controller type='ide' index='0'>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='ide'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 23:00:24 user nova-compute[74721]:     </controller>
Nov 02 23:00:24 user nova-compute[74721]:     <interface type='ethernet'>
Nov 02 23:00:24 user nova-compute[74721]:       <mac address='fa:16:3e:80:bf:49'/>
Nov 02 23:00:24 user nova-compute[74721]:       <target dev='tapdaef9cf0-de'/>
Nov 02 23:00:24 user nova-compute[74721]:       <model type='virtio'/>
Nov 02 23:00:24 user nova-compute[74721]:       <mtu size='1442'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='net0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </interface>
Nov 02 23:00:24 user nova-compute[74721]:     <interface type='ethernet'>
Nov 02 23:00:24 user nova-compute[74721]:       <mac address='fa:16:3e:c2:d3:45'/>
Nov 02 23:00:24 user nova-compute[74721]:       <target dev='tapa49f3161-72'/>
Nov 02 23:00:24 user nova-compute[74721]:       <model type='virtio'/>
Nov 02 23:00:24 user nova-compute[74721]:       <mtu size='1442'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='net1'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </interface>
Nov 02 23:00:24 user nova-compute[74721]:     <serial type='pty'>
Nov 02 23:00:24 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:24 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:24 user nova-compute[74721]:       <target type='isa-serial' port='0'>
Nov 02 23:00:24 user nova-compute[74721]:         <model name='isa-serial'/>
Nov 02 23:00:24 user nova-compute[74721]:       </target>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </serial>
Nov 02 23:00:24 user nova-compute[74721]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 23:00:24 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:24 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:24 user nova-compute[74721]:       <target type='serial' port='0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </console>
Nov 02 23:00:24 user nova-compute[74721]:     <input type='mouse' bus='ps2'>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='input0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </input>
Nov 02 23:00:24 user nova-compute[74721]:     <input type='keyboard' bus='ps2'>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='input1'/>
Nov 02 23:00:24 user nova-compute[74721]:     </input>
Nov 02 23:00:24 user nova-compute[74721]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 23:00:24 user nova-compute[74721]:       <listen type='address' address='0.0.0.0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </graphics>
Nov 02 23:00:24 user nova-compute[74721]:     <audio id='1' type='none'/>
Nov 02 23:00:24 user nova-compute[74721]:     <video>
Nov 02 23:00:24 user nova-compute[74721]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='video0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </video>
Nov 02 23:00:24 user nova-compute[74721]:     <memballoon model='virtio'>
Nov 02 23:00:24 user nova-compute[74721]:       <stats period='10'/>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='balloon0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:24 user nova-compute[74721]:     <rng model='virtio'>
Nov 02 23:00:24 user nova-compute[74721]:       <backend model='random'>/dev/urandom</backend>
Nov 02 23:00:24 user nova-compute[74721]:       <alias name='rng0'/>
Nov 02 23:00:24 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 23:00:24 user nova-compute[74721]:     </rng>
Nov 02 23:00:24 user nova-compute[74721]:   </devices>
Nov 02 23:00:24 user nova-compute[74721]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 23:00:24 user nova-compute[74721]:     <label>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</label>
Nov 02 23:00:24 user nova-compute[74721]:     <imagelabel>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</imagelabel>
Nov 02 23:00:24 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:24 user nova-compute[74721]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 23:00:24 user nova-compute[74721]:     <label>+64055:+108</label>
Nov 02 23:00:24 user nova-compute[74721]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 23:00:24 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:24 user nova-compute[74721]: </domain>
Nov 02 23:00:24 user nova-compute[74721]:  {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 23:00:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully detached device tapa49f3161-72 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the persistent domain config.
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] (1/8): Attempting to detach device tapa49f3161-72 with device alias net1 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] detach device xml: <interface type="ethernet">
Nov 02 23:00:24 user nova-compute[74721]:   <mac address="fa:16:3e:c2:d3:45"/>
Nov 02 23:00:24 user nova-compute[74721]:   <model type="virtio"/>
Nov 02 23:00:24 user nova-compute[74721]:   <mtu size="1442"/>
Nov 02 23:00:24 user nova-compute[74721]:   <target dev="tapa49f3161-72"/>
Nov 02 23:00:24 user nova-compute[74721]: </interface>
Nov 02 23:00:24 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Start waiting for the detach event from libvirt for device tapa49f3161-72 with device alias net1 for instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-unplugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-unplugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:24 user nova-compute[74721]: WARNING nova.compute.manager [req-6cccfb55-b6cc-4406-af7a-501d9eeba35a req-2edc7b2d-4e8d-4e4d-bb8b-3ae8e9cbb963 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-unplugged-a49f3161-72f9-4437-9d7c-a87d4c834918 for instance with vm_state active and task_state None.
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [{"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-5e10c2d6-c1ca-4189-8833-bc40b17e19f5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:25 user nova-compute[74721]: INFO nova.compute.manager [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Terminating instance
Nov 02 23:00:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-da5e7171-14a4-44ee-b303-e7c033330726 req-6e83b73a-1820-44c5-b74f-f6d067fcb674 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Instance destroyed successfully.
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lazy-loading 'resources' on Instance uuid 57e7fd79-796c-4531-bedd-969b531c343f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1808402758',display_name='tempest-AttachSCSIVolumeTestJSON-server-1808402758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1808402758',id=6,image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+HOOcPQmZQORve+E4+3EsUctoyhUV0QGQ6gZKe+RTjDY9UHEJobPozplF+WcmEA6dxeWb2IBAdc3tWZuLAUwXP+PjFATZmlssD9mWqCMpT+j2qy3xo5qS1ngsBfpvow==',key_name='tempest-keypair-619731102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e51a8371104288865539548619d4e4',ramdisk_id='',reservation_id='r-33ziejmv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9fe4b63e-93b1-4bd3-836f-1dd602c283f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1925784694',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1925784694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77b637ca53764e28b8c17734c925a0c2',uuid=57e7fd79-796c-4531-bedd-969b531c343f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converting VIF {"id": "4855034d-41d3-464b-b24c-f0c865ae6f41", "address": "fa:16:3e:f0:da:c1", "network": {"id": "dd48f8b2-3a42-4acd-9388-f014de36ba18", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627021978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e51a8371104288865539548619d4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4855034d-41", "ovs_interfaceid": "4855034d-41d3-464b-b24c-f0c865ae6f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG os_vif [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4855034d-41, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41bd773b-8664-4656-ab45-65b826d47abf) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:26 user nova-compute[74721]: INFO os_vif [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:da:c1,bridge_name='br-int',has_traffic_filtering=True,id=4855034d-41d3-464b-b24c-f0c865ae6f41,network=Network(dd48f8b2-3a42-4acd-9388-f014de36ba18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4855034d-41')
Nov 02 23:00:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Deleting instance files /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f_del
Nov 02 23:00:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Deletion of /opt/stack/data/nova/instances/57e7fd79-796c-4531-bedd-969b531c343f_del complete
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:26 user nova-compute[74721]: INFO nova.compute.manager [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:26 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:00:26 user nova-compute[74721]: INFO nova.compute.claims [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Claim successful on node user
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:27 user nova-compute[74721]: WARNING nova.compute.manager [req-8e021773-2ea0-4d1d-9cf3-1650879f878a req-eca8227d-5710-4725-84b5-6b7c05e9d149 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-a49f3161-72f9-4437-9d7c-a87d4c834918 for instance with vm_state active and task_state None.
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:27 user nova-compute[74721]: WARNING nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state active and task_state deleting.
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:27 user nova-compute[74721]: WARNING nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state active and task_state deleting.
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:27 user nova-compute[74721]: WARNING nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state active and task_state deleting.
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7e7b670-a1fc-4d33-bd91-a5774e903724 req-16ab09d4-e3e0-466e-9c61-cd144b57f4a3 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-unplugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.020s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:00:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.policy [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58614dc2b66e4f148f5caf8fa1e8f0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b0c73c0e50491b822af310ddfbd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:00:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Creating image(s)
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "/opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "/opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "/opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-5ad02e77-369f-4165-a450-0af191583f5a req-91f4b541-2d7e-4fc8-8c84-ebb43a20c5f1 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-deleted-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:28 user nova-compute[74721]: INFO nova.compute.manager [req-5ad02e77-369f-4165-a450-0af191583f5a req-91f4b541-2d7e-4fc8-8c84-ebb43a20c5f1 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Neutron deleted interface 4855034d-41d3-464b-b24c-f0c865ae6f41; detaching it from the instance and deleting it from the info cache
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-5ad02e77-369f-4165-a450-0af191583f5a req-91f4b541-2d7e-4fc8-8c84-ebb43a20c5f1 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:28 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Took 1.94 seconds to deallocate network for instance.
Nov 02 23:00:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-5ad02e77-369f-4165-a450-0af191583f5a req-91f4b541-2d7e-4fc8-8c84-ebb43a20c5f1 service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Detach interface failed, port_id=4855034d-41d3-464b-b24c-f0c865ae6f41, reason: Instance 57e7fd79-796c-4531-bedd-969b531c343f could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.225s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk 1073741824" returned: 0 in 0.140s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.257s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Successfully created port: 04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Cannot resize image /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Ensure instance console log exists: /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.781s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:29 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Deleted allocations for instance 57e7fd79-796c-4531-bedd-969b531c343f
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a7a9e06-f241-4b06-a6f2-681c2e92865b tempest-AttachSCSIVolumeTestJSON-1925784694 tempest-AttachSCSIVolumeTestJSON-1925784694-project-member] Lock "57e7fd79-796c-4531-bedd-969b531c343f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.627s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] Acquiring lock "57e7fd79-796c-4531-bedd-969b531c343f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] Lock "57e7fd79-796c-4531-bedd-969b531c343f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] No waiting events found dispatching network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:29 user nova-compute[74721]: WARNING nova.compute.manager [req-4e15eb84-86ff-4b61-a577-b9d1b4117577 req-ff7ff8a0-c9ea-4b38-9682-fd564434e1ac service nova] [instance: 57e7fd79-796c-4531-bedd-969b531c343f] Received unexpected event network-vif-plugged-4855034d-41d3-464b-b24c-f0c865ae6f41 for instance with vm_state deleted and task_state None.
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Successfully updated port: 04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquired lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Updating instance_info_cache with network_info: [{"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Releasing lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Instance network_info: |[{"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Start _get_guest_xml network_info=[{"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:00:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1386843645',display_name='tempest-VolumesAdminNegativeTest-server-1386843645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1386843645',id=13,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-hg966llc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:00:28Z,user_data=None,user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=caf64044-ba11-440c-8bfe-9c279a385350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.objects.instance [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'pci_devices' on Instance uuid caf64044-ba11-440c-8bfe-9c279a385350 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:00:30 user nova-compute[74721]:   <uuid>caf64044-ba11-440c-8bfe-9c279a385350</uuid>
Nov 02 23:00:30 user nova-compute[74721]:   <name>instance-0000000d</name>
Nov 02 23:00:30 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:00:30 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:00:30 user nova-compute[74721]:   <metadata>
Nov 02 23:00:30 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:30 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1386843645</nova:name>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:00:30</nova:creationTime>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:00:30 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:30 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:owner>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:user uuid="58614dc2b66e4f148f5caf8fa1e8f0d1">tempest-VolumesAdminNegativeTest-77842526-project-member</nova:user>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:project uuid="08b0c73c0e50491b822af310ddfbd64c">tempest-VolumesAdminNegativeTest-77842526</nova:project>
Nov 02 23:00:30 user nova-compute[74721]:       </nova:owner>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:30 user nova-compute[74721]:       <nova:ports>
Nov 02 23:00:30 user nova-compute[74721]:         <nova:port uuid="04f7518c-3291-4dd7-b6e3-77e5dc8256f0">
Nov 02 23:00:30 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 23:00:30 user nova-compute[74721]:         </nova:port>
Nov 02 23:00:30 user nova-compute[74721]:       </nova:ports>
Nov 02 23:00:30 user nova-compute[74721]:     </nova:instance>
Nov 02 23:00:30 user nova-compute[74721]:   </metadata>
Nov 02 23:00:30 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:00:30 user nova-compute[74721]:     <system>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="serial">caf64044-ba11-440c-8bfe-9c279a385350</entry>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="uuid">caf64044-ba11-440c-8bfe-9c279a385350</entry>
Nov 02 23:00:30 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:00:30 user nova-compute[74721]:     </system>
Nov 02 23:00:30 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:30 user nova-compute[74721]:   <os>
Nov 02 23:00:30 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:00:30 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:00:30 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:00:30 user nova-compute[74721]:   </os>
Nov 02 23:00:30 user nova-compute[74721]:   <features>
Nov 02 23:00:30 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:30 user nova-compute[74721]:     <apic/>
Nov 02 23:00:30 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:00:30 user nova-compute[74721]:   </features>
Nov 02 23:00:30 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:00:30 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:00:30 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:00:30 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:00:30 user nova-compute[74721]:   </clock>
Nov 02 23:00:30 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:00:30 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:00:30 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:00:30 user nova-compute[74721]:   </cpu>
Nov 02 23:00:30 user nova-compute[74721]:   <devices>
Nov 02 23:00:30 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:00:30 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:00:30 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk"/>
Nov 02 23:00:30 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:00:30 user nova-compute[74721]:     </disk>
Nov 02 23:00:30 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:00:30 user nova-compute[74721]:       <mac address="fa:16:3e:7f:80:7a"/>
Nov 02 23:00:30 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:30 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:00:30 user nova-compute[74721]:       <target dev="tap04f7518c-32"/>
Nov 02 23:00:30 user nova-compute[74721]:     </interface>
Nov 02 23:00:30 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:00:30 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/console.log" append="off"/>
Nov 02 23:00:30 user nova-compute[74721]:     </serial>
Nov 02 23:00:30 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:00:30 user nova-compute[74721]:     <video>
Nov 02 23:00:30 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:00:30 user nova-compute[74721]:     </video>
Nov 02 23:00:30 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:00:30 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:00:30 user nova-compute[74721]:     </rng>
Nov 02 23:00:30 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:00:30 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:00:30 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:00:30 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:30 user nova-compute[74721]:   </devices>
Nov 02 23:00:30 user nova-compute[74721]: </domain>
Nov 02 23:00:30 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1386843645',display_name='tempest-VolumesAdminNegativeTest-server-1386843645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1386843645',id=13,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-hg966llc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:00:28Z,user_data=None,user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=caf64044-ba11-440c-8bfe-9c279a385350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG os_vif [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd900cf33-3c8e-5cce-b279-5e36099b6411', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04f7518c-32, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04f7518c-32, col_values=(('qos', UUID('71836188-8563-4869-bc1d-7db11839e09d')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04f7518c-32, col_values=(('external_ids', {'iface-id': '04f7518c-3291-4dd7-b6e3-77e5dc8256f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:80:7a', 'vm-uuid': 'caf64044-ba11-440c-8bfe-9c279a385350'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:30 user nova-compute[74721]: INFO os_vif [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32')
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] No VIF found with MAC fa:16:3e:7f:80:7a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:31 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:31 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:31 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33925b64-4a43-42eb-851a-9642028310bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:00:31 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-changed-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Refreshing instance network info cache due to event network-changed-04f7518c-3291-4dd7-b6e3-77e5dc8256f0. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] Acquiring lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] Acquired lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG nova.network.neutron [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Refreshing network info cache for port 04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[48062fa4-bcc1-4569-b132-55a36ce82bba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added
Nov 02 23:00:31 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e148d5b1-17cb-43d6-a252-95fc133a3e57]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1cea8-1d8e-491b-8f43-d76de72e5a42]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c2d93a-c53b-4668-8581-341e3565ccd5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqvZMEri'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f9955-b792-466e-addc-61f008162731]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b7347-442d-4eac-b396-fc4e92fe80bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1c5b6-9ce4-49c5-8a3f-dee8d7709409]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:00:32 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d878883-b326-409c-9b0b-ef95457a5496]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b823633-5ab4-4dfb-81b1-ca6cecac2d33]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:32 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:32 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a53f502-96d3-4b78-9c3e-5119a0b5885b]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Updated VIF entry in instance network info cache for port 04f7518c-3291-4dd7-b6e3-77e5dc8256f0. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Updating instance_info_cache with network_info: [{"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83b36597-b6ea-4245-b77c-c380c4a32413 req-bdd6551f-1fab-4953-b96d-5761dc43c6af service nova] Releasing lock "refresh_cache-caf64044-ba11-440c-8bfe-9c279a385350" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'flavor' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:00:33 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:33 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:00:33 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:33 user nova-compute[74721]:   <serial>0d3e374a-a466-4f4f-90d5-8ca9f921cf71</serial>
Nov 02 23:00:33 user nova-compute[74721]: </disk>
Nov 02 23:00:33 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No VIF found with MAC fa:16:3e:04:f7:98, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] No waiting events found dispatching network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:34 user nova-compute[74721]: WARNING nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received unexpected event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 for instance with vm_state building and task_state spawning.
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] No waiting events found dispatching network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:34 user nova-compute[74721]: WARNING nova.compute.manager [req-26ddee07-1c7a-490f-b6f6-467f07b01da6 req-38afbbbf-98ee-4b9a-b3db-08246ed20416 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received unexpected event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 for instance with vm_state building and task_state spawning.
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cc504927-80fe-42c3-afdc-1e3749da150d tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.983s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:00:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Instance spawned successfully.
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:34 user nova-compute[74721]: INFO nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 02 23:00:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:35 user nova-compute[74721]: INFO nova.compute.manager [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Took 8.24 seconds to build instance.
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-93eee203-6c34-44fc-87b2-a48e8ac0f3d3 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.444s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdn (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Stashing vm_state: active {{(pid=74721) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:36 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:00:36 user nova-compute[74721]: INFO nova.compute.claims [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Claim successful on node user
Nov 02 23:00:36 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating resource usage from migration 1625457d-0281-461f-b038-302d92c545e6
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.782s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:37 user nova-compute[74721]: INFO nova.compute.manager [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Migrating
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:37 user nova-compute[74721]: INFO nova.compute.rpcapi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:00:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:38 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:38 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7125MB free_disk=25.386356353759766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:38 user nova-compute[74721]: INFO nova.compute.manager [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Terminating instance
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Applying migration context for instance bb70b80b-ebf8-4962-afa2-49de93c5b3af as it has an incoming, in-progress migration 1625457d-0281-461f-b038-302d92c545e6. Migration status is pre-migrating {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 23:00:38 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating resource usage from migration 1625457d-0281-461f-b038-302d92c545e6
Nov 02 23:00:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance caf64044-ba11-440c-8bfe-9c279a385350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Migration 1625457d-0281-461f-b038-302d92c545e6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 0241e103-9dcc-41ac-a2ff-27dc56ffc557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 373a06ee-b138-4325-b1f5-99e52d5355ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-unplugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] No waiting events found dispatching network-vif-unplugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-7870179c-3567-4ab8-9879-3636bde0f794 req-ef778ce2-ab9b-45f4-82fe-9fdb17f7ce16 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-unplugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Instance destroyed successfully.
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lazy-loading 'resources' on Instance uuid 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Starting migrate_disk_and_power_off {{(pid=74721) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1385668588',display_name='tempest-VolumesAssistedSnapshotsTest-server-1385668588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1385668588',id=9,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElKbxp2KdhJtAfrLjhmYAxai8NPlv7ZzgM/r9anYfJkpEyTv7sljGi8uepWz0jt06q/kLnGIWN6QaxG1LkYo20PvnOfLaOTTQcwYXPSVrQK98wCIxnOWywXjS92QWVA5A==',key_name='tempest-keypair-1424932714',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5450d4754cb14909b47768445b98695d',ramdisk_id='',reservation_id='r-o9bthxnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-476708363',owner_user_name='tempest-VolumesAssistedSnapshotsTest-476708363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='616c3bf4067e40e7819a7c03d10f8387',uuid=5fa6ebee-92d1-47f6-97ec-526d5de9b2a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converting VIF {"id": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "address": "fa:16:3e:53:4e:f8", "network": {"id": "aad2b948-8561-4e8e-988e-0a227eb1f633", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1843435328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5450d4754cb14909b47768445b98695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05c8c59a-f2", "ovs_interfaceid": "05c8c59a-f285-4876-9c9b-9d86a1a0137c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG os_vif [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05c8c59a-f2, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5266fcc2-0742-4d62-ad46-1d78e0165ec6) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.027s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:39 user nova-compute[74721]: INFO os_vif [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:f8,bridge_name='br-int',has_traffic_filtering=True,id=05c8c59a-f285-4876-9c9b-9d86a1a0137c,network=Network(aad2b948-8561-4e8e-988e-0a227eb1f633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05c8c59a-f2')
Nov 02 23:00:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Deleting instance files /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7_del
Nov 02 23:00:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Deletion of /opt/stack/data/nova/instances/5fa6ebee-92d1-47f6-97ec-526d5de9b2a7_del complete
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: INFO nova.compute.manager [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 02 23:00:39 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance destroyed successfully.
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4d474-9e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86d0795d-8f26-4e7d-b851-cebd90f07359) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:40 user nova-compute[74721]: INFO os_vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab0039-30ed-404c-9ff3-6ee350f262f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:40 user nova-compute[74721]: No targets found.
Nov 02 23:00:40 user nova-compute[74721]: iSNS:
Nov 02 23:00:40 user nova-compute[74721]: No targets found.
Nov 02 23:00:40 user nova-compute[74721]: STATIC:
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:40 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:40 user nova-compute[74721]: No targets found.
Nov 02 23:00:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:40 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:40 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e5f9b8-ea65-4bab-96ba-60440acf637e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f70366-1ab1-43c1-8b7c-821a7cdb13a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:40 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c392680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b45ed8-a68d-48d7-afd1-72a5b4ef26d4]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641f958-829f-4b35-a99d-1af65400a631]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb62026-8b0a-4f8f-86c4-879cacfe8520]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f0dde8-58e5-4bd6-9ccb-7eab76367923]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[457090fe-68ba-4e68-b127-ee388b74ac21]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71fcf7a-c3b4-41ea-bea2-f6a034c34d53]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:00:40 user nova-compute[74721]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c4c654-8362-468a-994c-a80115b98ec1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== disconnect_volume: return (453ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': '9854c732-f547-48c0-9e23-a2d38411b2b0', 'serial': '9854c732-f547-48c0-9e23-a2d38411b2b0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e'}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e', 'serial'} {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:40 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef88b60-1a34-4dcd-8cb5-2180765a33a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:00:40 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09df901-2ad3-437c-abab-a10186616ae0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0] added
Nov 02 23:00:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa15b3-d6fb-4968-9280-4c13285b1f46]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c7fa4-b5fd-4579-ac51-81643faddd13]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLWvDOSK {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLWvDOSK" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3cc7da-35fc-4842-923d-b289a4179abc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLWvDOSK'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda91f4-a3b5-402d-adea-7d0d30306999]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1521f484-893a-4e5b-9ecc-e4933404e284]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Acquiring lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] No waiting events found dispatching network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:41 user nova-compute[74721]: WARNING nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received unexpected event network-vif-plugged-05c8c59a-f285-4876-9c9b-9d86a1a0137c for instance with vm_state active and task_state deleting.
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:41 user nova-compute[74721]: WARNING nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state resize_migrating.
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:00:41 user nova-compute[74721]: WARNING nova.compute.manager [req-9650005c-7466-4fa5-8624-d33d7424c5b7 req-49aec27a-5c9b-4dc4-a8d7-249659b1c435 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state resize_migrating.
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6885cff-64dc-49a4-9a81-fa4037628915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]
Nov 02 23:00:41 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e53844c-93fe-4c82-ad46-fa70be22eec2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_resize/disk /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-4e394598-2124-47d0-998f-0fbe8455643a req-e0557b8c-e164-4a46-afcf-66bc06cc0f00 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Received event network-vif-deleted-05c8c59a-f285-4876-9c9b-9d86a1a0137c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:41 user nova-compute[74721]: INFO nova.compute.manager [req-4e394598-2124-47d0-998f-0fbe8455643a req-e0557b8c-e164-4a46-afcf-66bc06cc0f00 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Neutron deleted interface 05c8c59a-f285-4876-9c9b-9d86a1a0137c; detaching it from the instance and deleting it from the info cache
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-4e394598-2124-47d0-998f-0fbe8455643a req-e0557b8c-e164-4a46-afcf-66bc06cc0f00 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:41 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Took 1.76 seconds to deallocate network for instance.
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-4e394598-2124-47d0-998f-0fbe8455643a req-e0557b8c-e164-4a46-afcf-66bc06cc0f00 service nova] [instance: 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7] Detach interface failed, port_id=05c8c59a-f285-4876-9c9b-9d86a1a0137c, reason: Instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de93810-c50e-4923-8f0b-73af1c0301f4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:41 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d4643a-24c3-4905-9a62-60fb87cf2820]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "cp -r /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_resize/disk /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk" returned: 0 in 0.450s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_resize/disk.info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk.info {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "cp -r /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_resize/disk.info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk.info" returned: 0 in 0.043s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:00:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:42 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Deleted allocations for instance 5fa6ebee-92d1-47f6-97ec-526d5de9b2a7
Nov 02 23:00:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-848c6c98-28c5-43ce-b03f-66bc27d42757 tempest-VolumesAssistedSnapshotsTest-476708363 tempest-VolumesAssistedSnapshotsTest-476708363-project-member] Lock "5fa6ebee-92d1-47f6-97ec-526d5de9b2a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.714s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23331666363663563', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331666363663563', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:00:42 user nova-compute[74721]: DEBUG nova.objects.instance [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lazy-loading 'flavor' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd binding to destination host user is already ACTIVE {{(pid=74721) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 432013312 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Waiting for libvirt event about the detach of device tapa49f3161-72 with device alias net1 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 is timed out.
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 23:00:44 user nova-compute[74721]:   <name>instance-00000008</name>
Nov 02 23:00:44 user nova-compute[74721]:   <uuid>65971139-4ea2-4c05-b4ec-beb6e91bb571</uuid>
Nov 02 23:00:44 user nova-compute[74721]:   <metadata>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:44 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:creationTime>2023-11-02 22:58:05</nova:creationTime>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:44 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:44 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:44 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:port uuid="a49f3161-72f9-4437-9d7c-a87d4c834918">
Nov 02 23:00:44 user nova-compute[74721]:       <nova:ip type="fixed" address="10.10.10.47" ipVersion="4"/>
Nov 02 23:00:44 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:44 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:44 user nova-compute[74721]:   </metadata>
Nov 02 23:00:44 user nova-compute[74721]:   <memory unit='KiB'>524288</memory>
Nov 02 23:00:44 user nova-compute[74721]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 23:00:44 user nova-compute[74721]:   <vcpu placement='static'>1</vcpu>
Nov 02 23:00:44 user nova-compute[74721]:   <resource>
Nov 02 23:00:44 user nova-compute[74721]:     <partition>/machine</partition>
Nov 02 23:00:44 user nova-compute[74721]:   </resource>
Nov 02 23:00:44 user nova-compute[74721]:   <sysinfo type='smbios'>
Nov 02 23:00:44 user nova-compute[74721]:     <system>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='version'>0.0.0</entry>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='serial'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='uuid'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:44 user nova-compute[74721]:       <entry name='family'>Virtual Machine</entry>
Nov 02 23:00:44 user nova-compute[74721]:     </system>
Nov 02 23:00:44 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:44 user nova-compute[74721]:   <os>
Nov 02 23:00:44 user nova-compute[74721]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 23:00:44 user nova-compute[74721]:     <boot dev='hd'/>
Nov 02 23:00:44 user nova-compute[74721]:     <smbios mode='sysinfo'/>
Nov 02 23:00:44 user nova-compute[74721]:   </os>
Nov 02 23:00:44 user nova-compute[74721]:   <features>
Nov 02 23:00:44 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:44 user nova-compute[74721]:     <apic/>
Nov 02 23:00:44 user nova-compute[74721]:     <vmcoreinfo state='on'/>
Nov 02 23:00:44 user nova-compute[74721]:   </features>
Nov 02 23:00:44 user nova-compute[74721]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 23:00:44 user nova-compute[74721]:     <model fallback='forbid'>Nehalem</model>
Nov 02 23:00:44 user nova-compute[74721]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 23:00:44 user nova-compute[74721]:     <feature policy='require' name='vme'/>
Nov 02 23:00:44 user nova-compute[74721]:     <feature policy='require' name='x2apic'/>
Nov 02 23:00:44 user nova-compute[74721]:     <feature policy='require' name='hypervisor'/>
Nov 02 23:00:44 user nova-compute[74721]:   </cpu>
Nov 02 23:00:44 user nova-compute[74721]:   <clock offset='utc'>
Nov 02 23:00:44 user nova-compute[74721]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 23:00:44 user nova-compute[74721]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 23:00:44 user nova-compute[74721]:     <timer name='hpet' present='no'/>
Nov 02 23:00:44 user nova-compute[74721]:   </clock>
Nov 02 23:00:44 user nova-compute[74721]:   <on_poweroff>destroy</on_poweroff>
Nov 02 23:00:44 user nova-compute[74721]:   <on_reboot>restart</on_reboot>
Nov 02 23:00:44 user nova-compute[74721]:   <on_crash>destroy</on_crash>
Nov 02 23:00:44 user nova-compute[74721]:   <devices>
Nov 02 23:00:44 user nova-compute[74721]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 23:00:44 user nova-compute[74721]:     <disk type='file' device='disk'>
Nov 02 23:00:44 user nova-compute[74721]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 23:00:44 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk' index='2'/>
Nov 02 23:00:44 user nova-compute[74721]:       <backingStore type='file' index='3'>
Nov 02 23:00:44 user nova-compute[74721]:         <format type='raw'/>
Nov 02 23:00:44 user nova-compute[74721]:         <source file='/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e'/>
Nov 02 23:00:44 user nova-compute[74721]:         <backingStore/>
Nov 02 23:00:44 user nova-compute[74721]:       </backingStore>
Nov 02 23:00:44 user nova-compute[74721]:       <target dev='vda' bus='virtio'/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='virtio-disk0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </disk>
Nov 02 23:00:44 user nova-compute[74721]:     <disk type='file' device='cdrom'>
Nov 02 23:00:44 user nova-compute[74721]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 23:00:44 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config' index='1'/>
Nov 02 23:00:44 user nova-compute[74721]:       <backingStore/>
Nov 02 23:00:44 user nova-compute[74721]:       <target dev='hda' bus='ide'/>
Nov 02 23:00:44 user nova-compute[74721]:       <readonly/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='ide0-0-0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </disk>
Nov 02 23:00:44 user nova-compute[74721]:     <controller type='usb' index='0' model='none'>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='usb'/>
Nov 02 23:00:44 user nova-compute[74721]:     </controller>
Nov 02 23:00:44 user nova-compute[74721]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='pci.0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </controller>
Nov 02 23:00:44 user nova-compute[74721]:     <controller type='ide' index='0'>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='ide'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 23:00:44 user nova-compute[74721]:     </controller>
Nov 02 23:00:44 user nova-compute[74721]:     <interface type='ethernet'>
Nov 02 23:00:44 user nova-compute[74721]:       <mac address='fa:16:3e:80:bf:49'/>
Nov 02 23:00:44 user nova-compute[74721]:       <target dev='tapdaef9cf0-de'/>
Nov 02 23:00:44 user nova-compute[74721]:       <model type='virtio'/>
Nov 02 23:00:44 user nova-compute[74721]:       <mtu size='1442'/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='net0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </interface>
Nov 02 23:00:44 user nova-compute[74721]:     <serial type='pty'>
Nov 02 23:00:44 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:44 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:44 user nova-compute[74721]:       <target type='isa-serial' port='0'>
Nov 02 23:00:44 user nova-compute[74721]:         <model name='isa-serial'/>
Nov 02 23:00:44 user nova-compute[74721]:       </target>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </serial>
Nov 02 23:00:44 user nova-compute[74721]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 23:00:44 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:44 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:44 user nova-compute[74721]:       <target type='serial' port='0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </console>
Nov 02 23:00:44 user nova-compute[74721]:     <input type='mouse' bus='ps2'>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='input0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </input>
Nov 02 23:00:44 user nova-compute[74721]:     <input type='keyboard' bus='ps2'>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='input1'/>
Nov 02 23:00:44 user nova-compute[74721]:     </input>
Nov 02 23:00:44 user nova-compute[74721]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 23:00:44 user nova-compute[74721]:       <listen type='address' address='0.0.0.0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </graphics>
Nov 02 23:00:44 user nova-compute[74721]:     <audio id='1' type='none'/>
Nov 02 23:00:44 user nova-compute[74721]:     <video>
Nov 02 23:00:44 user nova-compute[74721]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='video0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </video>
Nov 02 23:00:44 user nova-compute[74721]:     <memballoon model='virtio'>
Nov 02 23:00:44 user nova-compute[74721]:       <stats period='10'/>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='balloon0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:44 user nova-compute[74721]:     <rng model='virtio'>
Nov 02 23:00:44 user nova-compute[74721]:       <backend model='random'>/dev/urandom</backend>
Nov 02 23:00:44 user nova-compute[74721]:       <alias name='rng0'/>
Nov 02 23:00:44 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 23:00:44 user nova-compute[74721]:     </rng>
Nov 02 23:00:44 user nova-compute[74721]:   </devices>
Nov 02 23:00:44 user nova-compute[74721]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 23:00:44 user nova-compute[74721]:     <label>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</label>
Nov 02 23:00:44 user nova-compute[74721]:     <imagelabel>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</imagelabel>
Nov 02 23:00:44 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:44 user nova-compute[74721]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 23:00:44 user nova-compute[74721]:     <label>+64055:+108</label>
Nov 02 23:00:44 user nova-compute[74721]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 23:00:44 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:44 user nova-compute[74721]: </domain>
Nov 02 23:00:44 user nova-compute[74721]:  {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 23:00:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully detached device tapa49f3161-72 from instance 65971139-4ea2-4c05-b4ec-beb6e91bb571 from the live domain config.
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_vif [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa49f3161-72, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8173053-93ed-43ca-b199-ff9971aac4ee) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:44 user nova-compute[74721]: INFO os_vif [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72')
Nov 02 23:00:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:44 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:creationTime>2023-11-02 23:00:44</nova:creationTime>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:44 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:44 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:44 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:44 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:44 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:44 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:44 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:44 user nova-compute[74721]:  {{(pid=74721) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.utils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4de9a6-3438-4ba2-bce5-793cbc9af46f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4972ef02-1cfc-4510-88b3-337db2406ed1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e14c07-2b7c-4ec3-ad54-6631a0047c20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[08052a88-2919-4086-9507-55822be0ce96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:00:44 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:00:44 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bd57a-9ead-4963-9641-b01b0ff82802]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:00:44 user nova-compute[74721]: DEBUG os_brick.utils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 602931200 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 751828992 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquired lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-deleted-a49f3161-72f9-4437-9d7c-a87d4c834918 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:00:45 user nova-compute[74721]: INFO nova.compute.manager [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Neutron deleted interface a49f3161-72f9-4437-9d7c-a87d4c834918; detaching it from the instance and deleting it from the info cache
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:45 user nova-compute[74721]: DEBUG nova.objects.instance [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Lazy-loading 'system_metadata' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.objects.instance [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Lazy-loading 'flavor' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.objects.base [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Object Instance<65971139-4ea2-4c05-b4ec-beb6e91bb571> lazy-loaded attributes: system_metadata,flavor {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 899678208 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 23:00:46 user nova-compute[74721]:   <name>instance-00000008</name>
Nov 02 23:00:46 user nova-compute[74721]:   <uuid>65971139-4ea2-4c05-b4ec-beb6e91bb571</uuid>
Nov 02 23:00:46 user nova-compute[74721]:   <metadata>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:46 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:creationTime>2023-11-02 23:00:44</nova:creationTime>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:46 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:46 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:46 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:46 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:46 user nova-compute[74721]:   </metadata>
Nov 02 23:00:46 user nova-compute[74721]:   <memory unit='KiB'>524288</memory>
Nov 02 23:00:46 user nova-compute[74721]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 23:00:46 user nova-compute[74721]:   <vcpu placement='static'>1</vcpu>
Nov 02 23:00:46 user nova-compute[74721]:   <resource>
Nov 02 23:00:46 user nova-compute[74721]:     <partition>/machine</partition>
Nov 02 23:00:46 user nova-compute[74721]:   </resource>
Nov 02 23:00:46 user nova-compute[74721]:   <sysinfo type='smbios'>
Nov 02 23:00:46 user nova-compute[74721]:     <system>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='version'>0.0.0</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='serial'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='uuid'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='family'>Virtual Machine</entry>
Nov 02 23:00:46 user nova-compute[74721]:     </system>
Nov 02 23:00:46 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:46 user nova-compute[74721]:   <os>
Nov 02 23:00:46 user nova-compute[74721]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 23:00:46 user nova-compute[74721]:     <boot dev='hd'/>
Nov 02 23:00:46 user nova-compute[74721]:     <smbios mode='sysinfo'/>
Nov 02 23:00:46 user nova-compute[74721]:   </os>
Nov 02 23:00:46 user nova-compute[74721]:   <features>
Nov 02 23:00:46 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:46 user nova-compute[74721]:     <apic/>
Nov 02 23:00:46 user nova-compute[74721]:     <vmcoreinfo state='on'/>
Nov 02 23:00:46 user nova-compute[74721]:   </features>
Nov 02 23:00:46 user nova-compute[74721]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 23:00:46 user nova-compute[74721]:     <model fallback='forbid'>Nehalem</model>
Nov 02 23:00:46 user nova-compute[74721]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='vme'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='x2apic'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='hypervisor'/>
Nov 02 23:00:46 user nova-compute[74721]:   </cpu>
Nov 02 23:00:46 user nova-compute[74721]:   <clock offset='utc'>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='hpet' present='no'/>
Nov 02 23:00:46 user nova-compute[74721]:   </clock>
Nov 02 23:00:46 user nova-compute[74721]:   <on_poweroff>destroy</on_poweroff>
Nov 02 23:00:46 user nova-compute[74721]:   <on_reboot>restart</on_reboot>
Nov 02 23:00:46 user nova-compute[74721]:   <on_crash>destroy</on_crash>
Nov 02 23:00:46 user nova-compute[74721]:   <devices>
Nov 02 23:00:46 user nova-compute[74721]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 23:00:46 user nova-compute[74721]:     <disk type='file' device='disk'>
Nov 02 23:00:46 user nova-compute[74721]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 23:00:46 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk' index='2'/>
Nov 02 23:00:46 user nova-compute[74721]:       <backingStore type='file' index='3'>
Nov 02 23:00:46 user nova-compute[74721]:         <format type='raw'/>
Nov 02 23:00:46 user nova-compute[74721]:         <source file='/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e'/>
Nov 02 23:00:46 user nova-compute[74721]:         <backingStore/>
Nov 02 23:00:46 user nova-compute[74721]:       </backingStore>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='vda' bus='virtio'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='virtio-disk0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </disk>
Nov 02 23:00:46 user nova-compute[74721]:     <disk type='file' device='cdrom'>
Nov 02 23:00:46 user nova-compute[74721]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 23:00:46 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config' index='1'/>
Nov 02 23:00:46 user nova-compute[74721]:       <backingStore/>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='hda' bus='ide'/>
Nov 02 23:00:46 user nova-compute[74721]:       <readonly/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='ide0-0-0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </disk>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='usb' index='0' model='none'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='usb'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='pci.0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='ide' index='0'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='ide'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <interface type='ethernet'>
Nov 02 23:00:46 user nova-compute[74721]:       <mac address='fa:16:3e:80:bf:49'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='tapdaef9cf0-de'/>
Nov 02 23:00:46 user nova-compute[74721]:       <model type='virtio'/>
Nov 02 23:00:46 user nova-compute[74721]:       <mtu size='1442'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='net0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </interface>
Nov 02 23:00:46 user nova-compute[74721]:     <serial type='pty'>
Nov 02 23:00:46 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:46 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target type='isa-serial' port='0'>
Nov 02 23:00:46 user nova-compute[74721]:         <model name='isa-serial'/>
Nov 02 23:00:46 user nova-compute[74721]:       </target>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </serial>
Nov 02 23:00:46 user nova-compute[74721]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 23:00:46 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:46 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target type='serial' port='0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </console>
Nov 02 23:00:46 user nova-compute[74721]:     <input type='mouse' bus='ps2'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='input0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </input>
Nov 02 23:00:46 user nova-compute[74721]:     <input type='keyboard' bus='ps2'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='input1'/>
Nov 02 23:00:46 user nova-compute[74721]:     </input>
Nov 02 23:00:46 user nova-compute[74721]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 23:00:46 user nova-compute[74721]:       <listen type='address' address='0.0.0.0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </graphics>
Nov 02 23:00:46 user nova-compute[74721]:     <audio id='1' type='none'/>
Nov 02 23:00:46 user nova-compute[74721]:     <video>
Nov 02 23:00:46 user nova-compute[74721]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='video0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </video>
Nov 02 23:00:46 user nova-compute[74721]:     <memballoon model='virtio'>
Nov 02 23:00:46 user nova-compute[74721]:       <stats period='10'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='balloon0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:46 user nova-compute[74721]:     <rng model='virtio'>
Nov 02 23:00:46 user nova-compute[74721]:       <backend model='random'>/dev/urandom</backend>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='rng0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </rng>
Nov 02 23:00:46 user nova-compute[74721]:   </devices>
Nov 02 23:00:46 user nova-compute[74721]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 23:00:46 user nova-compute[74721]:     <label>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</label>
Nov 02 23:00:46 user nova-compute[74721]:     <imagelabel>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</imagelabel>
Nov 02 23:00:46 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:46 user nova-compute[74721]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 23:00:46 user nova-compute[74721]:     <label>+64055:+108</label>
Nov 02 23:00:46 user nova-compute[74721]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 23:00:46 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:46 user nova-compute[74721]: </domain>
Nov 02 23:00:46 user nova-compute[74721]:  {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface> {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:d3:45"/><model type="virtio"/><mtu size="1442"/><target dev="tapa49f3161-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 23:00:46 user nova-compute[74721]:   <name>instance-00000008</name>
Nov 02 23:00:46 user nova-compute[74721]:   <uuid>65971139-4ea2-4c05-b4ec-beb6e91bb571</uuid>
Nov 02 23:00:46 user nova-compute[74721]:   <metadata>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:46 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:creationTime>2023-11-02 23:00:44</nova:creationTime>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:46 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:46 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:46 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:46 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:46 user nova-compute[74721]:   </metadata>
Nov 02 23:00:46 user nova-compute[74721]:   <memory unit='KiB'>524288</memory>
Nov 02 23:00:46 user nova-compute[74721]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 23:00:46 user nova-compute[74721]:   <vcpu placement='static'>1</vcpu>
Nov 02 23:00:46 user nova-compute[74721]:   <resource>
Nov 02 23:00:46 user nova-compute[74721]:     <partition>/machine</partition>
Nov 02 23:00:46 user nova-compute[74721]:   </resource>
Nov 02 23:00:46 user nova-compute[74721]:   <sysinfo type='smbios'>
Nov 02 23:00:46 user nova-compute[74721]:     <system>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='version'>0.0.0</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='serial'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='uuid'>65971139-4ea2-4c05-b4ec-beb6e91bb571</entry>
Nov 02 23:00:46 user nova-compute[74721]:       <entry name='family'>Virtual Machine</entry>
Nov 02 23:00:46 user nova-compute[74721]:     </system>
Nov 02 23:00:46 user nova-compute[74721]:   </sysinfo>
Nov 02 23:00:46 user nova-compute[74721]:   <os>
Nov 02 23:00:46 user nova-compute[74721]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 23:00:46 user nova-compute[74721]:     <boot dev='hd'/>
Nov 02 23:00:46 user nova-compute[74721]:     <smbios mode='sysinfo'/>
Nov 02 23:00:46 user nova-compute[74721]:   </os>
Nov 02 23:00:46 user nova-compute[74721]:   <features>
Nov 02 23:00:46 user nova-compute[74721]:     <acpi/>
Nov 02 23:00:46 user nova-compute[74721]:     <apic/>
Nov 02 23:00:46 user nova-compute[74721]:     <vmcoreinfo state='on'/>
Nov 02 23:00:46 user nova-compute[74721]:   </features>
Nov 02 23:00:46 user nova-compute[74721]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 23:00:46 user nova-compute[74721]:     <model fallback='forbid'>Nehalem</model>
Nov 02 23:00:46 user nova-compute[74721]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='vme'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='x2apic'/>
Nov 02 23:00:46 user nova-compute[74721]:     <feature policy='require' name='hypervisor'/>
Nov 02 23:00:46 user nova-compute[74721]:   </cpu>
Nov 02 23:00:46 user nova-compute[74721]:   <clock offset='utc'>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 23:00:46 user nova-compute[74721]:     <timer name='hpet' present='no'/>
Nov 02 23:00:46 user nova-compute[74721]:   </clock>
Nov 02 23:00:46 user nova-compute[74721]:   <on_poweroff>destroy</on_poweroff>
Nov 02 23:00:46 user nova-compute[74721]:   <on_reboot>restart</on_reboot>
Nov 02 23:00:46 user nova-compute[74721]:   <on_crash>destroy</on_crash>
Nov 02 23:00:46 user nova-compute[74721]:   <devices>
Nov 02 23:00:46 user nova-compute[74721]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 23:00:46 user nova-compute[74721]:     <disk type='file' device='disk'>
Nov 02 23:00:46 user nova-compute[74721]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 23:00:46 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk' index='2'/>
Nov 02 23:00:46 user nova-compute[74721]:       <backingStore type='file' index='3'>
Nov 02 23:00:46 user nova-compute[74721]:         <format type='raw'/>
Nov 02 23:00:46 user nova-compute[74721]:         <source file='/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e'/>
Nov 02 23:00:46 user nova-compute[74721]:         <backingStore/>
Nov 02 23:00:46 user nova-compute[74721]:       </backingStore>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='vda' bus='virtio'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='virtio-disk0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </disk>
Nov 02 23:00:46 user nova-compute[74721]:     <disk type='file' device='cdrom'>
Nov 02 23:00:46 user nova-compute[74721]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 23:00:46 user nova-compute[74721]:       <source file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/disk.config' index='1'/>
Nov 02 23:00:46 user nova-compute[74721]:       <backingStore/>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='hda' bus='ide'/>
Nov 02 23:00:46 user nova-compute[74721]:       <readonly/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='ide0-0-0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </disk>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='usb' index='0' model='none'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='usb'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='pci.0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <controller type='ide' index='0'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='ide'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 23:00:46 user nova-compute[74721]:     </controller>
Nov 02 23:00:46 user nova-compute[74721]:     <interface type='ethernet'>
Nov 02 23:00:46 user nova-compute[74721]:       <mac address='fa:16:3e:80:bf:49'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target dev='tapdaef9cf0-de'/>
Nov 02 23:00:46 user nova-compute[74721]:       <model type='virtio'/>
Nov 02 23:00:46 user nova-compute[74721]:       <mtu size='1442'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='net0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </interface>
Nov 02 23:00:46 user nova-compute[74721]:     <serial type='pty'>
Nov 02 23:00:46 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:46 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target type='isa-serial' port='0'>
Nov 02 23:00:46 user nova-compute[74721]:         <model name='isa-serial'/>
Nov 02 23:00:46 user nova-compute[74721]:       </target>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </serial>
Nov 02 23:00:46 user nova-compute[74721]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 23:00:46 user nova-compute[74721]:       <source path='/dev/pts/8'/>
Nov 02 23:00:46 user nova-compute[74721]:       <log file='/opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571/console.log' append='off'/>
Nov 02 23:00:46 user nova-compute[74721]:       <target type='serial' port='0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='serial0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </console>
Nov 02 23:00:46 user nova-compute[74721]:     <input type='mouse' bus='ps2'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='input0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </input>
Nov 02 23:00:46 user nova-compute[74721]:     <input type='keyboard' bus='ps2'>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='input1'/>
Nov 02 23:00:46 user nova-compute[74721]:     </input>
Nov 02 23:00:46 user nova-compute[74721]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 23:00:46 user nova-compute[74721]:       <listen type='address' address='0.0.0.0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </graphics>
Nov 02 23:00:46 user nova-compute[74721]:     <audio id='1' type='none'/>
Nov 02 23:00:46 user nova-compute[74721]:     <video>
Nov 02 23:00:46 user nova-compute[74721]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='video0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </video>
Nov 02 23:00:46 user nova-compute[74721]:     <memballoon model='virtio'>
Nov 02 23:00:46 user nova-compute[74721]:       <stats period='10'/>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='balloon0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </memballoon>
Nov 02 23:00:46 user nova-compute[74721]:     <rng model='virtio'>
Nov 02 23:00:46 user nova-compute[74721]:       <backend model='random'>/dev/urandom</backend>
Nov 02 23:00:46 user nova-compute[74721]:       <alias name='rng0'/>
Nov 02 23:00:46 user nova-compute[74721]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 23:00:46 user nova-compute[74721]:     </rng>
Nov 02 23:00:46 user nova-compute[74721]:   </devices>
Nov 02 23:00:46 user nova-compute[74721]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 23:00:46 user nova-compute[74721]:     <label>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</label>
Nov 02 23:00:46 user nova-compute[74721]:     <imagelabel>libvirt-65971139-4ea2-4c05-b4ec-beb6e91bb571</imagelabel>
Nov 02 23:00:46 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:46 user nova-compute[74721]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 23:00:46 user nova-compute[74721]:     <label>+64055:+108</label>
Nov 02 23:00:46 user nova-compute[74721]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 23:00:46 user nova-compute[74721]:   </seclabel>
Nov 02 23:00:46 user nova-compute[74721]: </domain>
Nov 02 23:00:46 user nova-compute[74721]:  {{(pid=74721) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 23:00:46 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Detaching interface fa:16:3e:c2:d3:45 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa49f3161-72' not found.
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Converting VIF {"id": "a49f3161-72f9-4437-9d7c-a87d4c834918", "address": "fa:16:3e:c2:d3:45", "network": {"id": "aca2b2f2-1209-4c68-b865-995c8b79b467", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1975775332", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49f3161-72", "ovs_interfaceid": "a49f3161-72f9-4437-9d7c-a87d4c834918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG os_vif [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa49f3161-72, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:00:46 user nova-compute[74721]: INFO os_vif [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=a49f3161-72f9-4437-9d7c-a87d4c834918,network=Network(aca2b2f2-1209-4c68-b865-995c8b79b467),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49f3161-72')
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [req-61025fec-cfd2-4e09-b0ed-691f0023c518 req-4169f763-322f-4a20-b792-6c5d2fad1d10 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:00:46 user nova-compute[74721]:   <nova:package version="0.0.0"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:name>tempest-device-tagging-server-422821031</nova:name>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:creationTime>2023-11-02 23:00:46</nova:creationTime>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:flavor name="m1.tiny">
Nov 02 23:00:46 user nova-compute[74721]:     <nova:memory>512</nova:memory>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:disk>1</nova:disk>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:swap>0</nova:swap>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:vcpus>1</nova:vcpus>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:flavor>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:user uuid="1143bb233a7247e5bde80acd173b10a9">tempest-TaggedAttachmentsTest-1293191290-project-member</nova:user>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:project uuid="046b3e882b89446fbae7d5b65f973bf4">tempest-TaggedAttachmentsTest-1293191290</nova:project>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:owner>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:00:46 user nova-compute[74721]:   <nova:ports>
Nov 02 23:00:46 user nova-compute[74721]:     <nova:port uuid="daef9cf0-de2c-4719-84a6-f5999eaa9204">
Nov 02 23:00:46 user nova-compute[74721]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:00:46 user nova-compute[74721]:     </nova:port>
Nov 02 23:00:46 user nova-compute[74721]:   </nova:ports>
Nov 02 23:00:46 user nova-compute[74721]: </nova:instance>
Nov 02 23:00:46 user nova-compute[74721]:  {{(pid=74721) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 23:00:46 user nova-compute[74721]: INFO nova.network.neutron [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Port a49f3161-72f9-4437-9d7c-a87d4c834918 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [{"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Releasing lock "refresh_cache-65971139-4ea2-4c05-b4ec-beb6e91bb571" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66fac31e-22d0-40e3-90ae-5bb1a1da308b tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "interface-65971139-4ea2-4c05-b4ec-beb6e91bb571-a49f3161-72f9-4437-9d7c-a87d4c834918" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.297s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNaqmEds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'daa25b40-8df3-47ca-a9e0-9edba355b26e'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:00:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32336c-fc52-497a-85e8-e73f3001c4ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:00:47 user nova-compute[74721]: No targets found.
Nov 02 23:00:47 user nova-compute[74721]: iSNS:
Nov 02 23:00:47 user nova-compute[74721]: No targets found.
Nov 02 23:00:47 user nova-compute[74721]: STATIC:
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:00:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:00:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:00:47 user nova-compute[74721]: FIRMWARE:
Nov 02 23:00:47 user nova-compute[74721]: No targets found.
Nov 02 23:00:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:00:47 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:00:47 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da180b9e-1f9c-4b0f-ae22-8dffd309a44c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[51487885-d80d-4b1b-a6a1-f05bc54a51d8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:00:47 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:00:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24375cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d9612-58b5-46ff-a377-e850defcff80]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cdc2a8-762a-4b1d-a3cc-82f0b91c0574]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[013263ac-6a12-4277-9fc8-904b613b6292]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b2a6ea-8927-4d9c-bfd6-77ca6d928a40]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc106746-f4b1-4f52-9a62-1d70f8d53f86]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff773d-7a02-4100-bc3d-77ccba4408a6]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260]
Nov 02 23:00:47 user nova-compute[74721]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e, portal: 172.16.0.220,3260] successful.
Nov 02 23:00:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa25b40-8df3-47ca-a9e0-9edba355b26e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c3865-a330-4f76-950c-d3b6e1722738]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] <== disconnect_volume: return (368ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc', 'attached_at': '', 'detached_at': '', 'volume_id': '9854c732-f547-48c0-9e23-a2d38411b2b0', 'serial'} {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 02 23:00:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: removing Cinder connection for volume daa25b40-8df3-47ca-a9e0-9edba355b26e {{(pid=74721) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 02 23:00:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] swap_volume: Updating volume daa25b40-8df3-47ca-a9e0-9edba355b26e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "nLWvDOSK", "auth_password": "b9PBe4OWnYzGd8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "9854c732-f547-48c0-9e23-a2d38411b2b0"}, "status": "reserved", "instance": "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc", "attached_at": "", "detached_at": "", "volume_id": "9854c732-f547-48c0-9e23-a2d38411b2b0", "serial": "9854c732-f547-48c0-9e23-a2d38411b2b0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9854c732-f547-48c0-9e23-a2d38411b2b0', 'no_device': None, 'attachment_id': '8f9cb94e-223e-4492-8458-814004cd5673'} {{(pid=74721) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 02 23:00:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-51cc51b0-0ff3-425c-a8c6-e18e5de6fa2a tempest-TestVolumeSwap-175013571 tempest-TestVolumeSwap-175013571-project-admin] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 36.408s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:00:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:00:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:00:50 user nova-compute[74721]: INFO nova.compute.manager [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Detaching volume 9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 23:00:50 user nova-compute[74721]: INFO nova.virt.block_device [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Attempting to driver detach volume 9854c732-f547-48c0-9e23-a2d38411b2b0 from mountpoint /dev/vdb
Nov 02 23:00:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Attempting to detach device vdb from instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:00:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:50 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:50 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:00:50 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:50 user nova-compute[74721]:   <serial>9854c732-f547-48c0-9e23-a2d38411b2b0</serial>
Nov 02 23:00:50 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:00:50 user nova-compute[74721]: </disk>
Nov 02 23:00:50 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Successfully detached device vdb from instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc from the persistent domain config.
Nov 02 23:00:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:00:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:00:50 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:00:50 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:00:50 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:00:50 user nova-compute[74721]:   <serial>9854c732-f547-48c0-9e23-a2d38411b2b0</serial>
Nov 02 23:00:50 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:00:50 user nova-compute[74721]: </disk>
Nov 02 23:00:50 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:00:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:00:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:00:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:01 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:01:01 user nova-compute[74721]: INFO nova.compute.claims [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Claim successful on node user
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:01:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.policy [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5150cf77c193400198252b77bd20bd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce6a9965b404965829f6aac42532bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:01:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Creating image(s)
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "/opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "/opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk 1073741824" returned: 0 in 0.044s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Successfully created port: d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Cannot resize image /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Ensure instance console log exists: /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Successfully updated port: d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquired lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-changed-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Refreshing instance network info cache due to event network-changed-d2eb2c39-078b-497d-9b8d-3230e31b9fb2. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] Acquiring lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Updating instance_info_cache with network_info: [{"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Releasing lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Instance network_info: |[{"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] Acquired lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Refreshing network info cache for port d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Start _get_guest_xml network_info=[{"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:01:03 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:03 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1257689052',display_name='tempest-VolumesActionsTest-instance-1257689052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1257689052',id=14,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce6a9965b404965829f6aac42532bbb',ramdisk_id='',reservation_id='r-zml3w76z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-899971655',owner_user_name='tempest-VolumesActionsTest-899971655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:01:03Z,user_data=None,user_id='5150cf77c193400198252b77bd20bd76',uuid=a3acac92-dcc5-424f-81e6-aa5623908271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converting VIF {"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:03 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lazy-loading 'pci_devices' on Instance uuid a3acac92-dcc5-424f-81e6-aa5623908271 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:01:04 user nova-compute[74721]:   <uuid>a3acac92-dcc5-424f-81e6-aa5623908271</uuid>
Nov 02 23:01:04 user nova-compute[74721]:   <name>instance-0000000e</name>
Nov 02 23:01:04 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:01:04 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:01:04 user nova-compute[74721]:   <metadata>
Nov 02 23:01:04 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:01:04 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:name>tempest-VolumesActionsTest-instance-1257689052</nova:name>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:01:03</nova:creationTime>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:01:04 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:01:04 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:owner>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:user uuid="5150cf77c193400198252b77bd20bd76">tempest-VolumesActionsTest-899971655-project-member</nova:user>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:project uuid="fce6a9965b404965829f6aac42532bbb">tempest-VolumesActionsTest-899971655</nova:project>
Nov 02 23:01:04 user nova-compute[74721]:       </nova:owner>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:01:04 user nova-compute[74721]:       <nova:ports>
Nov 02 23:01:04 user nova-compute[74721]:         <nova:port uuid="d2eb2c39-078b-497d-9b8d-3230e31b9fb2">
Nov 02 23:01:04 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 23:01:04 user nova-compute[74721]:         </nova:port>
Nov 02 23:01:04 user nova-compute[74721]:       </nova:ports>
Nov 02 23:01:04 user nova-compute[74721]:     </nova:instance>
Nov 02 23:01:04 user nova-compute[74721]:   </metadata>
Nov 02 23:01:04 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:01:04 user nova-compute[74721]:     <system>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="serial">a3acac92-dcc5-424f-81e6-aa5623908271</entry>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="uuid">a3acac92-dcc5-424f-81e6-aa5623908271</entry>
Nov 02 23:01:04 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:01:04 user nova-compute[74721]:     </system>
Nov 02 23:01:04 user nova-compute[74721]:   </sysinfo>
Nov 02 23:01:04 user nova-compute[74721]:   <os>
Nov 02 23:01:04 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:01:04 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:01:04 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:01:04 user nova-compute[74721]:   </os>
Nov 02 23:01:04 user nova-compute[74721]:   <features>
Nov 02 23:01:04 user nova-compute[74721]:     <acpi/>
Nov 02 23:01:04 user nova-compute[74721]:     <apic/>
Nov 02 23:01:04 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:01:04 user nova-compute[74721]:   </features>
Nov 02 23:01:04 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:01:04 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:01:04 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:01:04 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:01:04 user nova-compute[74721]:   </clock>
Nov 02 23:01:04 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:01:04 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:01:04 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:01:04 user nova-compute[74721]:   </cpu>
Nov 02 23:01:04 user nova-compute[74721]:   <devices>
Nov 02 23:01:04 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:01:04 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:01:04 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk"/>
Nov 02 23:01:04 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:01:04 user nova-compute[74721]:     </disk>
Nov 02 23:01:04 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:01:04 user nova-compute[74721]:       <mac address="fa:16:3e:cb:83:9a"/>
Nov 02 23:01:04 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:01:04 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:01:04 user nova-compute[74721]:       <target dev="tapd2eb2c39-07"/>
Nov 02 23:01:04 user nova-compute[74721]:     </interface>
Nov 02 23:01:04 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:01:04 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/console.log" append="off"/>
Nov 02 23:01:04 user nova-compute[74721]:     </serial>
Nov 02 23:01:04 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:01:04 user nova-compute[74721]:     <video>
Nov 02 23:01:04 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:01:04 user nova-compute[74721]:     </video>
Nov 02 23:01:04 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:01:04 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:01:04 user nova-compute[74721]:     </rng>
Nov 02 23:01:04 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:01:04 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:01:04 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:01:04 user nova-compute[74721]:     </memballoon>
Nov 02 23:01:04 user nova-compute[74721]:   </devices>
Nov 02 23:01:04 user nova-compute[74721]: </domain>
Nov 02 23:01:04 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1257689052',display_name='tempest-VolumesActionsTest-instance-1257689052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1257689052',id=14,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce6a9965b404965829f6aac42532bbb',ramdisk_id='',reservation_id='r-zml3w76z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-899971655',owner_user_name='tempest-VolumesActionsTest-899971655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:01:03Z,user_data=None,user_id='5150cf77c193400198252b77bd20bd76',uuid=a3acac92-dcc5-424f-81e6-aa5623908271,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converting VIF {"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG os_vif [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b29c73c-3e0f-58a0-a0c0-54ace0f5fc2b', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2eb2c39-07, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2eb2c39-07, col_values=(('qos', UUID('19ef340e-c10d-4a95-9b3a-c25cdbd83fe4')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2eb2c39-07, col_values=(('external_ids', {'iface-id': 'd2eb2c39-078b-497d-9b8d-3230e31b9fb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:83:9a', 'vm-uuid': 'a3acac92-dcc5-424f-81e6-aa5623908271'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:04 user nova-compute[74721]: INFO os_vif [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07')
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] No VIF found with MAC fa:16:3e:cb:83:9a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.network.neutron [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Updated VIF entry in instance network info cache for port d2eb2c39-078b-497d-9b8d-3230e31b9fb2. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG nova.network.neutron [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Updating instance_info_cache with network_info: [{"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32e5eaec-8aa1-4afe-a5d7-5459b0cb17d0 req-98702492-c15e-49d3-8a45-193d28ada03d service nova] Releasing lock "refresh_cache-a3acac92-dcc5-424f-81e6-aa5623908271" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] No waiting events found dispatching network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:05 user nova-compute[74721]: WARNING nova.compute.manager [req-70f766e8-c387-4622-9969-bccf2e1ea7b3 req-ae85eb30-3d4b-432b-9b26-7bbddf26a343 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received unexpected event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 for instance with vm_state building and task_state spawning.
Nov 02 23:01:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:01:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Instance spawned successfully.
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:01:07 user nova-compute[74721]: INFO nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:01:07 user nova-compute[74721]: INFO nova.compute.manager [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Took 5.90 seconds to build instance.
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] No waiting events found dispatching network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:07 user nova-compute[74721]: WARNING nova.compute.manager [req-706faca3-abe0-4d07-87d7-4c36549948df req-667b8357-549e-4be2-aa05-921fa078e266 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received unexpected event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 for instance with vm_state active and task_state None.
Nov 02 23:01:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f502cd3e-7083-41c8-be14-16ffe3ddbad3 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.012s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Starting finish_migration {{(pid=74721) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:01:08 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Creating image(s)
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk. size=21474836480 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk 21474836480 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk 21474836480" returned: 0 in 0.050s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Ensure instance console log exists: /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start _get_guest_xml network_info=[{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '989b474a-6035-4f12-921b-8f594f646555', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb70b80b-ebf8-4962-afa2-49de93c5b3af', 'attached_at': '2023-11-02T23:01:08.000000', 'detached_at': '', 'volume_id': '0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'serial': '0d3e374a-a466-4f4f-90d5-8ca9f921cf71'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:01:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:08 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:08 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:08 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf6821-2248-4f84-8199-27a714790ae9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:01:08 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b49418d-ec9e-49d7-b196-a589653dbc43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added
Nov 02 23:01:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64caea-907b-4a2c-a9c0-dc7fcb623c3b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[57355688-9a51-425f-baf9-f956b353661d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ecf578-726c-48f5-b80d-7c03cf325399]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqvZMEri'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[91205995-a725-49e8-bdba-8dc0218aa44c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9614259-06e4-477e-8708-4601d7f78933]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:08 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[214800e1-7e0b-4b44-b136-9bce6c82a054]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:01:09 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213e667-3477-44e7-b661-5574cd4b416b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de6193-b523-4db3-8889-86d67a1baf75]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:09 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f3458-7ba9-43f8-a8ca-b9ffd7d0172d]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:01:10 user nova-compute[74721]:   <uuid>bb70b80b-ebf8-4962-afa2-49de93c5b3af</uuid>
Nov 02 23:01:10 user nova-compute[74721]:   <name>instance-00000002</name>
Nov 02 23:01:10 user nova-compute[74721]:   <memory>2097152</memory>
Nov 02 23:01:10 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:01:10 user nova-compute[74721]:   <metadata>
Nov 02 23:01:10 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:01:10 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherB-server-639869915</nova:name>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:01:08</nova:creationTime>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:flavor name="m1.small">
Nov 02 23:01:10 user nova-compute[74721]:         <nova:memory>2048</nova:memory>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:disk>20</nova:disk>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:01:10 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:owner>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:user uuid="821e324c9ed4485dbb9fd3d2200b6427">tempest-ServerActionsTestOtherB-371613091-project-member</nova:user>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:project uuid="2fc43b8d380f489291403f7300e9a48c">tempest-ServerActionsTestOtherB-371613091</nova:project>
Nov 02 23:01:10 user nova-compute[74721]:       </nova:owner>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:01:10 user nova-compute[74721]:       <nova:ports>
Nov 02 23:01:10 user nova-compute[74721]:         <nova:port uuid="e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd">
Nov 02 23:01:10 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:01:10 user nova-compute[74721]:         </nova:port>
Nov 02 23:01:10 user nova-compute[74721]:       </nova:ports>
Nov 02 23:01:10 user nova-compute[74721]:     </nova:instance>
Nov 02 23:01:10 user nova-compute[74721]:   </metadata>
Nov 02 23:01:10 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:01:10 user nova-compute[74721]:     <system>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="serial">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="uuid">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 23:01:10 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:01:10 user nova-compute[74721]:     </system>
Nov 02 23:01:10 user nova-compute[74721]:   </sysinfo>
Nov 02 23:01:10 user nova-compute[74721]:   <os>
Nov 02 23:01:10 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:01:10 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:01:10 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:01:10 user nova-compute[74721]:   </os>
Nov 02 23:01:10 user nova-compute[74721]:   <features>
Nov 02 23:01:10 user nova-compute[74721]:     <acpi/>
Nov 02 23:01:10 user nova-compute[74721]:     <apic/>
Nov 02 23:01:10 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:01:10 user nova-compute[74721]:   </features>
Nov 02 23:01:10 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:01:10 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:01:10 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:01:10 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:01:10 user nova-compute[74721]:   </clock>
Nov 02 23:01:10 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:01:10 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:01:10 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:01:10 user nova-compute[74721]:   </cpu>
Nov 02 23:01:10 user nova-compute[74721]:   <devices>
Nov 02 23:01:10 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:01:10 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:01:10 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk"/>
Nov 02 23:01:10 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:01:10 user nova-compute[74721]:     </disk>
Nov 02 23:01:10 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:01:10 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:01:10 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:01:10 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:01:10 user nova-compute[74721]:       <serial>0d3e374a-a466-4f4f-90d5-8ca9f921cf71</serial>
Nov 02 23:01:10 user nova-compute[74721]:     </disk>
Nov 02 23:01:10 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:01:10 user nova-compute[74721]:       <mac address="fa:16:3e:04:f7:98"/>
Nov 02 23:01:10 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:01:10 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:01:10 user nova-compute[74721]:       <target dev="tape4e4d474-9e"/>
Nov 02 23:01:10 user nova-compute[74721]:     </interface>
Nov 02 23:01:10 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:01:10 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/console.log" append="off"/>
Nov 02 23:01:10 user nova-compute[74721]:     </serial>
Nov 02 23:01:10 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:01:10 user nova-compute[74721]:     <video>
Nov 02 23:01:10 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:01:10 user nova-compute[74721]:     </video>
Nov 02 23:01:10 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:01:10 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:01:10 user nova-compute[74721]:     </rng>
Nov 02 23:01:10 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:01:10 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:01:10 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:01:10 user nova-compute[74721]:     </memballoon>
Nov 02 23:01:10 user nova-compute[74721]:   </devices>
Nov 02 23:01:10 user nova-compute[74721]: </domain>
Nov 02 23:01:10 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-294679311-network", "vif_mac": "fa:16:3e:04:f7:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG os_vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25be48b0-36bf-5e38-83b4-c5aa20750405', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4d474-9e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4e4d474-9e, col_values=(('qos', UUID('34784b95-c88b-45b5-a264-1ab3377740b1')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4e4d474-9e, col_values=(('external_ids', {'iface-id': 'e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f7:98', 'vm-uuid': 'bb70b80b-ebf8-4962-afa2-49de93c5b3af'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:10 user nova-compute[74721]: INFO os_vif [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] No VIF found with MAC fa:16:3e:04:f7:98, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:01:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc is timed out.
Nov 02 23:01:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Successfully detached device vdb from instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc from the live domain config.
Nov 02 23:01:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLWvDOSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '9854c732-f547-48c0-9e23-a2d38411b2b0'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:11 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e53939-b159-48b1-b1d2-52f2ed795492]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:11 user nova-compute[74721]: No targets found.
Nov 02 23:01:11 user nova-compute[74721]: iSNS:
Nov 02 23:01:11 user nova-compute[74721]: No targets found.
Nov 02 23:01:11 user nova-compute[74721]: STATIC:
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:11 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:11 user nova-compute[74721]: No targets found.
Nov 02 23:01:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:11 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:11 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f0777c-c480-43bc-b99c-2e95aad26997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1eafaa-4f28-4390-89c9-6edd407664e2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:11 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c1cc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a7ea6-a58d-4aae-b077-a16b44ea64f2]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b145666b-4c1c-46c9-a475-c8e73cbf77fb]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3080de-a2e3-4c9f-b772-3181373b95c0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[095cbd05-874a-4565-8e9d-bf3042afa234]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee7adb-067e-42f2-acf2-be13f55a942c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83ebf3-fa70-4cfe-9888-399634d549da]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260]
Nov 02 23:01:11 user nova-compute[74721]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9854c732-f547-48c0-9e23-a2d38411b2b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef227b02-d73f-43de-ad19-62325c9a0dfc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] <== disconnect_volume: return (389ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:12 user nova-compute[74721]: WARNING nova.compute.manager [req-4a0e29cb-f437-4639-ae6b-0fd1ec6c8bfa req-a971ccf0-733d-4ea3-8a9d-60ab04f9630d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state resize_finish.
Nov 02 23:01:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lazy-loading 'flavor' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-changed-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing instance network info cache due to event network-changed-483244bf-572e-4243-b8e0-dfc60d29a3fa. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] Acquiring lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] Acquired lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG nova.network.neutron [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Refreshing network info cache for port 483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:01:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0c5e5d60-c075-4ccc-9276-96aefaf8ebd8 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.179s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updated VIF entry in instance network info cache for port 483244bf-572e-4243-b8e0-dfc60d29a3fa. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:01:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e675738b-b801-48b4-a98a-35d0aa30f2c9 req-cb1fea3a-16bf-430b-a36c-9d08e5a2bfbc service nova] Releasing lock "refresh_cache-0241e103-9dcc-41ac-a2ff-27dc56ffc557" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:14 user nova-compute[74721]: WARNING nova.compute.manager [req-c9cb4d4a-1005-4c79-b4f8-4d6c9908242b req-07a4f735-fe3a-4640-a6d2-6ad8a5660e92 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state resize_finish.
Nov 02 23:01:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:01:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance running successfully.
Nov 02 23:01:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Failed to set time: agent not configured {{(pid=74721) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 23:01:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8d7086b5-fa6f-4182-aefc-88366f8b7d17 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] finish_migration finished successfully. {{(pid=74721) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:15 user nova-compute[74721]: INFO nova.compute.manager [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Terminating instance
Nov 02 23:01:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-unplugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-unplugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-45a938f1-77dc-4bc1-a164-3f814246fef8 req-0a81a14a-6905-49b2-90a7-ba935803b5ba service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-unplugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:15 user nova-compute[74721]: INFO nova.compute.manager [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Terminating instance
Nov 02 23:01:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:01:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Instance destroyed successfully.
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.objects.instance [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lazy-loading 'resources' on Instance uuid 65971139-4ea2-4c05-b4ec-beb6e91bb571 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-422821031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-422821031',id=8,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguLaT8wbu4DDuGMvvpH9pFnSuRgES6MoTJway0cVEeNsJ5cxoLvVFPNqQ2k5EO6AL8gqSkX01FsxBbrFwWY8DsZha6A3gcoAh/BZnToya08kE6rFOIzKe2Kuk8bo5yKw==',key_name='tempest-keypair-995066235',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046b3e882b89446fbae7d5b65f973bf4',ramdisk_id='',reservation_id='r-2yhz1p62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293191290',owner_user_name='tempest-TaggedAttachmentsTest-1293191290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1143bb233a7247e5bde80acd173b10a9',uuid=65971139-4ea2-4c05-b4ec-beb6e91bb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converting VIF {"id": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "address": "fa:16:3e:80:bf:49", "network": {"id": "412107c4-6e41-4df4-992d-4137e474bf31", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-976326109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046b3e882b89446fbae7d5b65f973bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaef9cf0-de", "ovs_interfaceid": "daef9cf0-de2c-4719-84a6-f5999eaa9204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG os_vif [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaef9cf0-de, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef94a6b-4aba-4b57-9701-a75e86fb0396) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-c20ddb25-5c7c-4534-989e-cb2e19783c2c req-3217deec-b59a-4591-8063-6b36ac190850 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-483244bf-572e-4243-b8e0-dfc60d29a3fa for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: INFO os_vif [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bf:49,bridge_name='br-int',has_traffic_filtering=True,id=daef9cf0-de2c-4719-84a6-f5999eaa9204,network=Network(412107c4-6e41-4df4-992d-4137e474bf31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaef9cf0-de')
Nov 02 23:01:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Deleting instance files /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571_del
Nov 02 23:01:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Deletion of /opt/stack/data/nova/instances/65971139-4ea2-4c05-b4ec-beb6e91bb571_del complete
Nov 02 23:01:16 user nova-compute[74721]: INFO nova.compute.manager [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 02 23:01:16 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-3ef50cee-9dc5-45e7-8026-398040323e2c req-2697e410-1d1e-44f2-8463-1e508ac0c078 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Instance destroyed successfully.
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lazy-loading 'resources' on Instance uuid 0241e103-9dcc-41ac-a2ff-27dc56ffc557 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "address": "fa:16:3e:bd:3b:18", "network": {"id": "07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086559460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483244bf-57", "ovs_interfaceid": "483244bf-572e-4243-b8e0-dfc60d29a3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap483244bf-57, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04cdafcc-abd6-44f9-b81b-73048cd7664d) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Acquiring lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] No waiting events found dispatching network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:17 user nova-compute[74721]: WARNING nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received unexpected event network-vif-plugged-daef9cf0-de2c-4719-84a6-f5999eaa9204 for instance with vm_state active and task_state deleting.
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:17 user nova-compute[74721]: WARNING nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8 for instance with vm_state active and task_state deleting.
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-572f3c00-ede0-4f9d-822a-c70dbefd2adf req-e6678095-96f0-4c58-a485-9081afe2d7d6 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:3b:18,bridge_name='br-int',has_traffic_filtering=True,id=483244bf-572e-4243-b8e0-dfc60d29a3fa,network=Network(07b57e0a-4e8d-4a3a-a5c9-6f34cfb70893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483244bf-57')
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape22c445c-6b, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be33639e-4502-48d3-a3fc-e224a3f5e8ea) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:9b:46,bridge_name='br-int',has_traffic_filtering=True,id=e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape22c445c-6b')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63e5181a-a1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba887dcb-e1c4-4ea0-ade1-3efd16f174d6) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:79:00,bridge_name='br-int',has_traffic_filtering=True,id=63e5181a-a169-4372-9c3d-f77aa795e6d2,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63e5181a-a1')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf77f280c-4b, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9086b06b-91eb-4b38-afcc-4ab27eb51929) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:18:17,bridge_name='br-int',has_traffic_filtering=True,id=f77f280c-4beb-4114-bfac-bd4a698cd0e3,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f280c-4b')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5c644c1-23, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a42bf767-2c1e-4cdc-ad84-9cf6e43e034c) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3f:cb,bridge_name='br-int',has_traffic_filtering=True,id=d5c644c1-2364-4442-b23d-df99f33ecd4b,network=Network(40f78131-1f0b-44cc-8325-9dd4c1337ea6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c644c1-23')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c9097b3-ff, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f97d3c25-d927-4624-85ac-65b957a31685) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a6:c9,bridge_name='br-int',has_traffic_filtering=True,id=5c9097b3-ff85-4e46-bc3a-91671ebf532a,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9097b3-ff')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-106389717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-106389717',id=11,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lzSQIJq/Gfx1Dz99mZMSZobgATDZi9NDEmR9ZZfXNUgocSTKqJvP//vBXedI800JxWXoHTvNiZbS+V2rXkXXcRmN0mrnMQVapl9Nv7aD+7RO0dka396Zf+nizbLkEEg==',key_name='tempest-keypair-637869768',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='435a346312f2486c8f3608b2ccd87751',ramdisk_id='',reservation_id='r-z7nvyczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1605118171',owner_user_name='tempest-TaggedBootDevicesTest-1605118171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd8b427e6174283be4beb2fdc8fa65c',uuid=0241e103-9dcc-41ac-a2ff-27dc56ffc557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converting VIF {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd23f2fc9-2f, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=806fb06e-8dc8-4510-888a-082665ececb0) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:18 user nova-compute[74721]: INFO os_vif [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:45:68,bridge_name='br-int',has_traffic_filtering=True,id=d23f2fc9-2f80-46b7-93d5-a5ec18a32370,network=Network(dc8c00aa-ec4b-4aea-a148-242d2268e05b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23f2fc9-2f')
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siIdjPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:18 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9dec0a-00bd-4b40-b339-0c5fa81a21f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]: iSNS:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]: STATIC:
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:18 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:18 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e00398-2a08-4f6b-a40f-01f7753516b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[be274e87-2a20-4345-80cd-ab68bf6fcab8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:18 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243dd6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d'): ({'sdf'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Removing single pathed devices sdf {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:18 user nova-compute[74721]: WARNING nova.compute.manager [req-8e6ffb2d-a334-4955-a525-45a203792c2f req-78a6afb3-41ad-492f-9671-9c4ebb9f69a8 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-483244bf-572e-4243-b8e0-dfc60d29a3fa for instance with vm_state active and task_state deleting.
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b0f60-9d87-4e86-a743-995c263bda18]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d2309-08d5-456f-bd9c-a91b1bf85c3c]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Flushing IO for device /dev/sdf {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[64037d05-383c-4866-ad02-da5e43d660f7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:18 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Took 1.95 seconds to deallocate network for instance.
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6b0230-1e30-4e49-9da9-44f30719b6c6]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[267910aa-0d6a-41d2-b609-4774b9445040]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c49317-2c8a-4013-9510-a98e1ac3b35a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260]
Nov 02 23:01:18 user nova-compute[74721]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5b465f-ca6a-48fe-8ac3-0c5a297b263d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[816ad750-e062-49a2-b1a3-bc0f253c9dac]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== disconnect_volume: return (502ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJRIGnmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:18 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1621a79-db5b-4683-b069-de5996a4e636]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]: iSNS:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]: STATIC:
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:18 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:18 user nova-compute[74721]: No targets found.
Nov 02 23:01:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:18 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:18 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecf988-0852-4c98-bb86-02f15374ce47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e39d9-eed1-4e6b-ac8f-92a108ebc612]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2420b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c'): ({'sdg'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Removing single pathed devices sdg {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING nova.compute.manager [req-4fb28f84-e219-45ec-9d9c-e75a057b4769 req-eff5f8bb-aeb4-46d3-a43d-78470ccea289 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-f77f280c-4beb-4114-bfac-bd4a698cd0e3 for instance with vm_state active and task_state deleting.
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d204aa11-6004-4e32-b367-293b18425bae]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9697a0a-09a5-401a-86be-c672081862f3]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Flushing IO for device /dev/sdg {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[648492fe-8fab-4fd4-ac5a-7a5745e60108]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0693cd-af74-495c-aef1-31158179816a]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] SCSI volumes sdg have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9903bbfc-b880-44d8-80ef-56a06d9c040a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5006c6-f9ec-4b31-bb9a-7c066bd2837c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260]
Nov 02 23:01:19 user nova-compute[74721]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec253e27-90a2-4b9f-a437-118938d6ee8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f47520-519e-4b74-95aa-4069b2ecc3d7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== disconnect_volume: return (463ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.684s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiYOAUru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b519b0-52c4-4359-b986-20f3d3ddcc4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:19 user nova-compute[74721]: No targets found.
Nov 02 23:01:19 user nova-compute[74721]: iSNS:
Nov 02 23:01:19 user nova-compute[74721]: No targets found.
Nov 02 23:01:19 user nova-compute[74721]: STATIC:
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:19 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:19 user nova-compute[74721]: No targets found.
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:19 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:19 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Deleted allocations for instance 65971139-4ea2-4c05-b4ec-beb6e91bb571
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682ae53-4934-4c51-ab82-5c6d29c816a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec65483b-944e-44da-b0a9-22d960f80040]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:19 user nova-compute[74721]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b (non-flash)
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf47cd3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b'): ({'sdh'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Removing single pathed devices sdh {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff584c-7bb8-43a3-ba0f-476f0d2dbf56]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ee9e0-3180-47fb-9240-0b0728fd7043]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Flushing IO for device /dev/sdh {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da69a2-ce8d-4e18-b9bc-39cce8cf471f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-baf127a7-61c9-4496-b017-d6adfffec13d tempest-TaggedAttachmentsTest-1293191290 tempest-TaggedAttachmentsTest-1293191290-project-member] Lock "65971139-4ea2-4c05-b4ec-beb6e91bb571" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.539s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a18973-0621-44d0-81a0-6d63cb69752b]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] SCSI volumes sdh have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e4e55-b8b0-4a7c-ac47-8a7e2098fcb8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88c0dcd-9ce2-4c5f-8e3b-693a55f98bf0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260]
Nov 02 23:01:19 user nova-compute[74721]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39f9e2b-1311-4ba3-b32c-166dac96f29b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e949f0ee-a8b7-4720-ba2b-24d0beeb4464]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] <== disconnect_volume: return (391ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Deleting instance files /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557_del
Nov 02 23:01:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Deletion of /opt/stack/data/nova/instances/0241e103-9dcc-41ac-a2ff-27dc56ffc557_del complete
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-63e5181a-a169-4372-9c3d-f77aa795e6d2 for instance with vm_state active and task_state deleting.
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-5c9097b3-ff85-4e46-bc3a-91671ebf532a for instance with vm_state active and task_state deleting.
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 65971139-4ea2-4c05-b4ec-beb6e91bb571] Received event network-vif-deleted-daef9cf0-de2c-4719-84a6-f5999eaa9204 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-d5c644c1-2364-4442-b23d-df99f33ecd4b for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d5c644c1-2364-4442-b23d-df99f33ecd4b for instance with vm_state active and task_state deleting.
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-unplugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-unplugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Acquiring lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] No waiting events found dispatching network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ffe2d00-57dc-47c0-afd1-bd995e207182 req-4e64ff79-fadd-49b6-9458-4ed9d646f6a3 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received unexpected event network-vif-plugged-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 for instance with vm_state active and task_state deleting.
Nov 02 23:01:19 user nova-compute[74721]: INFO nova.compute.manager [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Took 4.20 seconds to destroy the instance on the hypervisor.
Nov 02 23:01:19 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:01:19 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:01:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-2c45be72-babd-4a49-bba2-7a77949648d0 req-91f6288e-443c-4249-ab99-6fcc0bcff5b9 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-deleted-483244bf-572e-4243-b8e0-dfc60d29a3fa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:21 user nova-compute[74721]: INFO nova.compute.manager [req-2c45be72-babd-4a49-bba2-7a77949648d0 req-91f6288e-443c-4249-ab99-6fcc0bcff5b9 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Neutron deleted interface 483244bf-572e-4243-b8e0-dfc60d29a3fa; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-2c45be72-babd-4a49-bba2-7a77949648d0 req-91f6288e-443c-4249-ab99-6fcc0bcff5b9 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [{"id": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "address": "fa:16:3e:a0:9b:46", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22c445c-6b", "ovs_interfaceid": "e22c445c-6b50-44fb-9aa4-b2ebcd1e6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "address": "fa:16:3e:73:79:00", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e5181a-a1", "ovs_interfaceid": "63e5181a-a169-4372-9c3d-f77aa795e6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "address": "fa:16:3e:2d:18:17", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f280c-4b", "ovs_interfaceid": "f77f280c-4beb-4114-bfac-bd4a698cd0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "address": "fa:16:3e:5c:3f:cb", "network": {"id": "40f78131-1f0b-44cc-8325-9dd4c1337ea6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092545863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c644c1-23", "ovs_interfaceid": "d5c644c1-2364-4442-b23d-df99f33ecd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "address": "fa:16:3e:b0:a6:c9", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9097b3-ff", "ovs_interfaceid": "5c9097b3-ff85-4e46-bc3a-91671ebf532a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "address": "fa:16:3e:84:45:68", "network": {"id": "dc8c00aa-ec4b-4aea-a148-242d2268e05b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711216516", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "435a346312f2486c8f3608b2ccd87751", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23f2fc9-2f", "ovs_interfaceid": "d23f2fc9-2f80-46b7-93d5-a5ec18a32370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-2c45be72-babd-4a49-bba2-7a77949648d0 req-91f6288e-443c-4249-ab99-6fcc0bcff5b9 service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Detach interface failed, port_id=483244bf-572e-4243-b8e0-dfc60d29a3fa, reason: Instance 0241e103-9dcc-41ac-a2ff-27dc56ffc557 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-changed-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Refreshing instance network info cache due to event network-changed-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] Acquiring lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] Acquired lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Refreshing network info cache for port 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updated VIF entry in instance network info cache for port 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating instance_info_cache with network_info: [{"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7bc288e-f894-454d-950a-2fcab9b6c6a7 req-c241192e-73df-446d-bbab-0c305fe392e2 service nova] Releasing lock "refresh_cache-28634ace-efa2-45a1-bbd9-9bb3f29bef01" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'flavor' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:23 user nova-compute[74721]: INFO nova.compute.manager [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attaching volume 2d05853f-583d-4eab-b2cf-db8333787930 to /dev/vdb
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.utils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac2f38-b5e1-4cb5-b85d-3f52592bfae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0d19de-b99d-475d-b9bf-91cd9e7fc26a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05fae7d-c365-49ec-a884-4fc7d54581ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1e0c4-3a2f-439d-a8c4-bf44b151bf5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:01:23 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:01:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa0a68-7f20-4dcb-9bb5-9042eaf36e94]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG os_brick.utils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating existing volume attachment record: 880bfd97-890e-4d26-a30e-32309df5c2ac {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:01:23 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:23 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Took 3.53 seconds to deallocate network for instance.
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-69177924-b4c6-4799-a887-662d4a779f51 req-03bb64b9-8215-4299-a2a1-a039268e75ba service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-deleted-d5c644c1-2364-4442-b23d-df99f33ecd4b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-69177924-b4c6-4799-a887-662d4a779f51 req-03bb64b9-8215-4299-a2a1-a039268e75ba service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-deleted-d23f2fc9-2f80-46b7-93d5-a5ec18a32370 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-69177924-b4c6-4799-a887-662d4a779f51 req-03bb64b9-8215-4299-a2a1-a039268e75ba service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-deleted-5c9097b3-ff85-4e46-bc3a-91671ebf532a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-69177924-b4c6-4799-a887-662d4a779f51 req-03bb64b9-8215-4299-a2a1-a039268e75ba service nova] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Received event network-vif-deleted-f77f280c-4beb-4114-bfac-bd4a698cd0e3 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:01:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:01:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:26 user nova-compute[74721]: INFO nova.compute.manager [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] [instance: 0241e103-9dcc-41ac-a2ff-27dc56ffc557] Took 2.83 seconds to detach 3 volumes for instance.
Nov 02 23:01:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:26 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:26 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:01:26 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:01:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:27 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Deleted allocations for instance 0241e103-9dcc-41ac-a2ff-27dc56ffc557
Nov 02 23:01:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6199f0-3155-4d28-ad71-e527302c583e tempest-TaggedBootDevicesTest-1605118171 tempest-TaggedBootDevicesTest-1605118171-project-member] Lock "0241e103-9dcc-41ac-a2ff-27dc56ffc557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.397s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:01:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:01:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:31 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdn (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:36 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:36 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:01:36 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7125MB free_disk=25.382701873779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Applying migration context for instance bb70b80b-ebf8-4962-afa2-49de93c5b3af as it has an incoming, in-progress migration 1625457d-0281-461f-b038-302d92c545e6. Migration status is finished {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 23:01:37 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating resource usage from migration 1625457d-0281-461f-b038-302d92c545e6
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 373a06ee-b138-4325-b1f5-99e52d5355ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance caf64044-ba11-440c-8bfe-9c279a385350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Migration 1625457d-0281-461f-b038-302d92c545e6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance a3acac92-dcc5-424f-81e6-aa5623908271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.816s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:01:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:40 user nova-compute[74721]: INFO nova.compute.manager [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Terminating instance
Nov 02 23:01:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-unplugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] No waiting events found dispatching network-vif-unplugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-376ee70c-0caa-4eb8-9b32-4baf30c5bc51 req-0ad93adb-c442-4256-8a6f-6ccc3e32c863 service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-unplugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Instance destroyed successfully.
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lazy-loading 'resources' on Instance uuid 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2020667730',display_name='tempest-TestVolumeSwap-server-2020667730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2020667730',id=7,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAGa/HA4KhaouNBJOgNO/LqkXF9qeey5r8jevzbsvRDZxaG7+yQc3qE6ZJM5HJrJ+Kv7kPILs9EetFn1Dzoanl/lobQ2Kqa8242wefPtDEwzl39Pn/Wou5bxNm50R13yw==',key_name='tempest-keypair-1198555046',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ce82279ae74e80b7b31c5465b2e8fc',ramdisk_id='',reservation_id='r-ff9wj67i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1130811799',owner_user_name='tempest-TestVolumeSwap-1130811799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6eca999eda14ff3922db1af2088e121',uuid=102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converting VIF {"id": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "address": "fa:16:3e:0c:f1:3a", "network": {"id": "ad1e164d-8a75-4bb8-95bc-4a3564153a71", "bridge": "br-int", "label": "tempest-TestVolumeSwap-290741011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ce82279ae74e80b7b31c5465b2e8fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8435099b-ed", "ovs_interfaceid": "8435099b-ed0e-41cc-a0cb-15abc14df2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG os_vif [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8435099b-ed, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ed0490a-f787-43cf-b415-453fc1043896) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:41 user nova-compute[74721]: INFO os_vif [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=8435099b-ed0e-41cc-a0cb-15abc14df2ce,network=Network(ad1e164d-8a75-4bb8-95bc-4a3564153a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8435099b-ed')
Nov 02 23:01:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Deleting instance files /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc_del
Nov 02 23:01:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Deletion of /opt/stack/data/nova/instances/102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc_del complete
Nov 02 23:01:41 user nova-compute[74721]: INFO nova.compute.manager [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 02 23:01:41 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:01:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:42 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:42 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Took 0.83 seconds to deallocate network for instance.
Nov 02 23:01:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] Acquiring lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] No waiting events found dispatching network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:43 user nova-compute[74721]: WARNING nova.compute.manager [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received unexpected event network-vif-plugged-8435099b-ed0e-41cc-a0cb-15abc14df2ce for instance with vm_state deleted and task_state None.
Nov 02 23:01:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-0ef06196-e429-413a-aa42-19d2a780de9a req-cee8c598-c88a-4e58-813f-6d6d0e29c3cb service nova] [instance: 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc] Received event network-vif-deleted-8435099b-ed0e-41cc-a0cb-15abc14df2ce {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:43 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Deleted allocations for instance 102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc
Nov 02 23:01:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68d87b2f-f586-439d-a570-a86965f9d561 tempest-TestVolumeSwap-1130811799 tempest-TestVolumeSwap-1130811799-project-member] Lock "102333ec-4f99-4bb1-bf0a-4f67b3f2d7bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-changed-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing instance network info cache due to event network-changed-6c248aba-4058-4f40-ab25-4edccbffbac2. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] Acquiring lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] Acquired lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Refreshing network info cache for port 6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updated VIF entry in instance network info cache for port 6c248aba-4058-4f40-ab25-4edccbffbac2. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a0ba95e0-ceac-461a-92c7-3d2740ff57d9 req-7345bf5d-6725-4c34-a619-ce1fd7dea082 service nova] Releasing lock "refresh_cache-373a06ee-b138-4325-b1f5-99e52d5355ad" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:46 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:46 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:46 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7cb0c-41dd-4a7d-9568-8c2b43c1d9c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:01:46 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee55584-d296-4c68-8151-19bb6540ce78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930] added
Nov 02 23:01:46 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40b75f-0294-4e19-8535-6c56fe794d34]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f45ad4-e3d0-4d78-b7c8-6633ad028a0c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuaspfZV {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuaspfZV" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63c0d3-aa33-4bdc-9876-875346011445]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuaspfZV'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b3dce-d2e9-4e3c-9c22-2931e2599fb8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd918991-3c18-4a9a-8b34-602e5c3444a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:46 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --login" returned: 0 in 1.084s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a899ba-14ae-47e9-9baf-1750b9eab43f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]
Nov 02 23:01:47 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310d467-9dde-4cc7-924f-1958b7d9ff33]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dba30c-9820-48c7-94ef-6ae2d66b5302]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.335s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f56d49-f786-48e3-8abe-7536a387f46c]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:48 user nova-compute[74721]: INFO nova.compute.manager [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Terminating instance
Nov 02 23:01:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-de64f336-6e04-4266-9d09-2f715beb3210 req-14fb10d3-74a2-467d-99d2-a59c04a963b4 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-6c248aba-4058-4f40-ab25-4edccbffbac2 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.375s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== connect_volume: return (2377ms) {'type': 'block', 'scsi_wwn': '26663643261393333', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663643261393333', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'flavor' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:01:49 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:01:49 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:01:49 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:01:49 user nova-compute[74721]:   <serial>2d05853f-583d-4eab-b2cf-db8333787930</serial>
Nov 02 23:01:49 user nova-compute[74721]: </disk>
Nov 02 23:01:49 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-76feaa6c-08d4-4fe2-b319-daaed2fca7be req-8385591c-f94c-4558-bc38-67404a8570e6 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-46237ef5-8c9a-43a9-8f7e-e5c26275c855 req-bb056bc9-cf87-4595-9ea3-50c9bd3bdaa0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: INFO nova.compute.manager [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Detaching volume df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:49 user nova-compute[74721]: INFO nova.virt.block_device [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Attempting to driver detach volume df05287d-23e4-46c6-8726-3dc1d326c8c6 from mountpoint /dev/vdb
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Attempting to detach device vdb from instance 80e598d8-a24f-412f-a083-3de7b0b853b3 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:01:49 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:01:49 user nova-compute[74721]:   <source dev="/dev/sdm"/>
Nov 02 23:01:49 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:01:49 user nova-compute[74721]:   <serial>df05287d-23e4-46c6-8726-3dc1d326c8c6</serial>
Nov 02 23:01:49 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:01:49 user nova-compute[74721]: </disk>
Nov 02 23:01:49 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:01:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdb from instance 80e598d8-a24f-412f-a083-3de7b0b853b3 from the persistent domain config.
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80e598d8-a24f-412f-a083-3de7b0b853b3 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:01:49 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:01:49 user nova-compute[74721]:   <source dev="/dev/sdm"/>
Nov 02 23:01:49 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:01:49 user nova-compute[74721]:   <serial>df05287d-23e4-46c6-8726-3dc1d326c8c6</serial>
Nov 02 23:01:49 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:01:49 user nova-compute[74721]: </disk>
Nov 02 23:01:49 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:3b:45:fe, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6fe16494-a6b1-4538-a05c-e9946d231d39 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.706s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:01:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Instance destroyed successfully.
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.objects.instance [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lazy-loading 'resources' on Instance uuid 373a06ee-b138-4325-b1f5-99e52d5355ad {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "6c248aba-4058-4f40-ab25-4edccbffbac2", "address": "fa:16:3e:fc:12:57", "network": {"id": "107489a8-3505-4fc4-bc13-7169ed932768", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2139464439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c248aba-40", "ovs_interfaceid": "6c248aba-4058-4f40-ab25-4edccbffbac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c248aba-40, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b7064c-cd14-4a32-92fa-41b6be65058e) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:12:57,bridge_name='br-int',has_traffic_filtering=True,id=6c248aba-4058-4f40-ab25-4edccbffbac2,network=Network(107489a8-3505-4fc4-bc13-7169ed932768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c248aba-40')
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58222433-a0, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b5bc59c-9c66-4ddb-83d9-6b7aeed9643b) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:fd:51,bridge_name='br-int',has_traffic_filtering=True,id=58222433-a0d5-462c-825e-803a15173831,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58222433-a0')
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dfeee28-de, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a812f3b-7533-461f-a59d-97096abb3947) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a0:62,bridge_name='br-int',has_traffic_filtering=True,id=3dfeee28-dee7-4b73-ad7a-73398fe62b77,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dfeee28-de')
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa725e652-27, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:50 user nova-compute[74721]: WARNING nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-6c248aba-4058-4f40-ab25-4edccbffbac2 for instance with vm_state active and task_state deleting.
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-58222433-a0d5-462c-825e-803a15173831 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:50 user nova-compute[74721]: WARNING nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-58222433-a0d5-462c-825e-803a15173831 for instance with vm_state active and task_state deleting.
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:50 user nova-compute[74721]: WARNING nova.compute.manager [req-842675ca-e5df-438e-b316-622512a943cd req-7a518d28-332f-43a2-9357-60d2a9924f5b service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-3dfeee28-dee7-4b73-ad7a-73398fe62b77 for instance with vm_state active and task_state deleting.
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81f3a6ba-8042-4a62-907b-8f5c487c23ef) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:bd,bridge_name='br-int',has_traffic_filtering=True,id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa725e652-27')
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57bb8303-4c, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd41a1aa-e8b0-44e2-bfba-3cef314a9904) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:51 user nova-compute[74721]: INFO nova.compute.manager [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Rebuilding instance
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f,network=Network(5dee0947-ec37-465b-8c64-4a6cf5a9c0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57bb8303-4c')
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7bc3ca-bf, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbe6037c-aa54-4eee-8260-eda7b68ea7c0) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:68:83,bridge_name='br-int',has_traffic_filtering=True,id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7bc3ca-bf')
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T22:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656943302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-656943302',id=10,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOurm2YGR7RRxFsDr7harYNTREIXwEWytpTkD8gRxI3NRB0wi/knRJTqjQj6BDyI8rwVWIPEgmGm/nIQDPkd3QOtG7ngHn9txtYAZuXc2dKxtkk2cTZD411IYELs31raFg==',key_name='tempest-keypair-700517716',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbdbbaa0b1c4805960775f6ffb5dcbb',ramdisk_id='',reservation_id='r-9w7j0m2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746374325',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746374325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e34182d4a774631bafacee47c987a09',uuid=373a06ee-b138-4325-b1f5-99e52d5355ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converting VIF {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap919a774d-ae, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1a798c9-3b0e-4818-9d01-2f8b91f7f455) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: INFO os_vif [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bb:bb,bridge_name='br-int',has_traffic_filtering=True,id=919a774d-ae56-4e37-8e8e-afb72a999938,network=Network(9edd0cf1-56f8-4e06-9ecd-7fb13a940407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919a774d-ae')
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJngoLTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca9410-b95b-4dcd-a9bc-83d57c1b051a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]: iSNS:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]: STATIC:
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:51 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:51 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbecdd9-bd9a-4b9b-b7d7-87d4ddece5b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 for instance with vm_state active and task_state deleting.
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-919a774d-ae56-4e37-8e8e-afb72a999938 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING nova.compute.manager [req-13840f1f-3d6e-4fe4-bfa4-b808c1f2db94 req-fa31b1ef-ddd3-4ece-aeed-0972ac5bb344 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-919a774d-ae56-4e37-8e8e-afb72a999938 for instance with vm_state active and task_state deleting.
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd9ad0d-e46a-414f-87e1-28cc2f1bfb72]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2464b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b904e-b51b-4e7e-aada-ed9e3b261067]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e30907-f908-4115-9013-64554793f252]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933ff2e-7f0b-4885-83ef-6bb798e71347]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3fe65-63d8-4a53-8941-9196125b9566]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ef30d-f781-488a-bdd1-349c78327cd1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-57bb8303-4cf0-4772-99e7-b9fa7d796e9f for instance with vm_state active and task_state deleting.
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-unplugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-unplugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Acquiring lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] No waiting events found dispatching network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING nova.compute.manager [req-928787f0-8896-415f-bca0-d7925baef151 req-ab3decc4-0a20-463a-bb10-1e08a2b3c7a0 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received unexpected event network-vif-plugged-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf for instance with vm_state active and task_state deleting.
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be9c7f-881e-4dc7-b4e1-9d60095e9fa4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260]
Nov 02 23:01:51 user nova-compute[74721]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b588f0ac-6217-4a4b-8c20-ad426082ed54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d2eaf3-ed8c-4768-b29d-e0ef6050ee06]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== disconnect_volume: return (390ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCPUHFJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831ee31-2e54-497c-95af-f63d3e5b00a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]: iSNS:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]: STATIC:
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:51 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:51 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:51 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:51 user nova-compute[74721]: No targets found.
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:51 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:51 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a22739-d454-4695-ad2f-77ab4cfda914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c30d268-f775-4195-a4fc-fd69a45848f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf47c843a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df'): ({'sdk'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Removing single pathed devices sdk {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d67a4-92c4-4cd9-ae1f-a773c966f785]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d3b4f-f6a5-4d7c-bc90-b75d3b71398a]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Flushing IO for device /dev/sdk {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[049101ea-3903-4fe6-9e57-32c5a469f7d6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[07440c7b-7c5d-476e-8989-d911352cc7bc]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] SCSI volumes sdk have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3290878-10d6-4099-91aa-076eeb001336]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8c660-4ac8-4d18-876b-da13a9d76bf3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260]
Nov 02 23:01:51 user nova-compute[74721]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e338d1a-860e-479e-bf8b-f5d9e5ef04df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5d83b-1d02-4a00-944d-0910c1711462]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== disconnect_volume: return (390ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSmlhPrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:51 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d6726-a2dc-4b84-9541-908173b15a72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]: iSNS:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]: STATIC:
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:52 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:52 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance destroyed successfully.
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1259a35a-bed7-4c26-a3c9-50c4ffb915b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4c1f4-1789-4347-bc83-d6876028b87b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2464bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0'): ({'sdl'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Removing single pathed devices sdl {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd94294-5e51-4c92-a7bb-4dcdf6814e18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.compute.manager [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Detaching volume 2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[035fcb74-5cfb-46e6-8c35-814905acc781]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Flushing IO for device /dev/sdl {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.012s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[db438415-d690-4313-8729-b9b8d62c5a91]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.virt.block_device [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attempting to driver detach volume 2d05853f-583d-4eab-b2cf-db8333787930 from mountpoint /dev/vdb
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b6409-1e62-4321-a8ee-012bfa7c2254]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] SCSI volumes sdl have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Attempting to detach device vdb from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:01:52 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:01:52 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:01:52 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:01:52 user nova-compute[74721]:   <serial>2d05853f-583d-4eab-b2cf-db8333787930</serial>
Nov 02 23:01:52 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:01:52 user nova-compute[74721]: </disk>
Nov 02 23:01:52 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb616e44-9673-4c8a-887e-80c42a1bea92]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully detached device vdb from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the persistent domain config.
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:52 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fdb788-ec24-47fc-9e6a-477e2f891f00]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260]
Nov 02 23:01:52 user nova-compute[74721]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85c05348-1b74-47b4-8a71-108a9256c3c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ec5c0-b36d-4adf-b48e-bfef5610361c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] <== disconnect_volume: return (404ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Deleting instance files /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad_del
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Deletion of /opt/stack/data/nova/instances/373a06ee-b138-4325-b1f5-99e52d5355ad_del complete
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.105s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de2a0a-50a1-4042-a478-225b0f38dfd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]: iSNS:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]: STATIC:
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:52 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:52 user nova-compute[74721]: No targets found.
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:52 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:52 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514c825-796f-4dd2-b09d-2c743b453f02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc3d18-c9d3-48f4-b652-3aa7286fde29]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c1cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: INFO nova.compute.manager [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Took 4.04 seconds to destroy the instance on the hypervisor.
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40e33f3-9291-416b-8d7b-d38db6e6c836]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a601a-52d3-4dfc-ab07-50f4b76153bc]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573dfe5-696e-4c38-990e-e9803c9df838]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a3924-5662-4cc9-909c-087237d1daa6]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2097460-5849-4a48-ab35-84312e1f7037]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[233de3a5-8013-43f4-80c3-453684780eaa]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]
Nov 02 23:01:52 user nova-compute[74721]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.
Nov 02 23:01:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f06b3-1d5a-49c2-82e3-c1956378751c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== disconnect_volume: return (410ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:53 user nova-compute[74721]: WARNING nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state active and task_state rebuilding.
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:01:53 user nova-compute[74721]: WARNING nova.compute.manager [req-4442ae0b-ee5b-4443-ba09-c4a05367bbee req-a2342e67-005b-47c4-b109-d4da4fd12ba4 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state active and task_state rebuilding.
Nov 02 23:01:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance destroyed successfully.
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-ServerActionsTestOtherA-server-1950633378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a7c3d26-0a, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb83a94-ec63-46e5-b109-13e27225c4fe) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:53 user nova-compute[74721]: INFO os_vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a')
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:53 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[31489e01-3c10-4139-bf59-bbe79caa94dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:01:53 user nova-compute[74721]: No targets found.
Nov 02 23:01:53 user nova-compute[74721]: iSNS:
Nov 02 23:01:53 user nova-compute[74721]: No targets found.
Nov 02 23:01:53 user nova-compute[74721]: STATIC:
Nov 02 23:01:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:01:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:01:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:01:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:01:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:01:53 user nova-compute[74721]: FIRMWARE:
Nov 02 23:01:53 user nova-compute[74721]: No targets found.
Nov 02 23:01:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:01:53 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:01:53 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bcdf63-7987-4ef6-b796-3e5c271a5f09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29a3ff3-4504-485b-8034-6c8aff1fba65]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:01:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24101cf0>, {}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Disconnecting from: [] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== disconnect_volume: return (99ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:01:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Deleting instance files /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01_del
Nov 02 23:01:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Deletion of /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01_del complete
Nov 02 23:01:54 user nova-compute[74721]: INFO nova.virt.block_device [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Booting with volume 2d05853f-583d-4eab-b2cf-db8333787930 at /dev/vdb
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.utils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e144c-b1d7-45da-9eda-d1e99b77c9b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d62ab84-8f41-4dd3-8514-ac5d0bd8482f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c241f8-7533-4247-a352-7e72932255a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d034aba-76bc-478d-8fad-2ba61f990531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:01:54 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:01:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bece72f-b267-479a-837c-2e46eafd9d37]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG os_brick.utils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating existing volume attachment record: adde52d2-e49f-40ba-92c0-f8923fa43f32 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-2fe92c07-eefe-4cb6-8c91-99475911cd0d req-3d20be46-d9f5-4fef-9dae-e425bad06354 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-deleted-6c248aba-4058-4f40-ab25-4edccbffbac2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:54 user nova-compute[74721]: INFO nova.compute.manager [req-2fe92c07-eefe-4cb6-8c91-99475911cd0d req-3d20be46-d9f5-4fef-9dae-e425bad06354 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Neutron deleted interface 6c248aba-4058-4f40-ab25-4edccbffbac2; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:54 user nova-compute[74721]: DEBUG nova.network.neutron [req-2fe92c07-eefe-4cb6-8c91-99475911cd0d req-3d20be46-d9f5-4fef-9dae-e425bad06354 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "address": "fa:16:3e:d6:68:83", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7bc3ca-bf", "ovs_interfaceid": "1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-2fe92c07-eefe-4cb6-8c91-99475911cd0d req-3d20be46-d9f5-4fef-9dae-e425bad06354 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Detach interface failed, port_id=6c248aba-4058-4f40-ab25-4edccbffbac2, reason: Instance 373a06ee-b138-4325-b1f5-99e52d5355ad could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-deleted-1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:56 user nova-compute[74721]: INFO nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Neutron deleted interface 1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.network.neutron [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "919a774d-ae56-4e37-8e8e-afb72a999938", "address": "fa:16:3e:44:bb:bb", "network": {"id": "9edd0cf1-56f8-4e06-9ecd-7fb13a940407", "bridge": "br-int", "label": "tempest-device-tagging-net2-1911745072", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919a774d-ae", "ovs_interfaceid": "919a774d-ae56-4e37-8e8e-afb72a999938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Detach interface failed, port_id=1f7bc3ca-bf9b-48b1-b96c-9fcf7c81c9bf, reason: Instance 373a06ee-b138-4325-b1f5-99e52d5355ad could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-deleted-919a774d-ae56-4e37-8e8e-afb72a999938 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:56 user nova-compute[74721]: INFO nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Neutron deleted interface 919a774d-ae56-4e37-8e8e-afb72a999938; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.network.neutron [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "address": "fa:16:3e:fb:c8:bd", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa725e652-27", "ovs_interfaceid": "a725e652-27f1-4b26-bbf7-3ae8d8b09e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:56 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Took 4.50 seconds to deallocate network for instance.
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Detach interface failed, port_id=919a774d-ae56-4e37-8e8e-afb72a999938, reason: Instance 373a06ee-b138-4325-b1f5-99e52d5355ad could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-deleted-a725e652-27f1-4b26-bbf7-3ae8d8b09e70 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:56 user nova-compute[74721]: INFO nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Neutron deleted interface a725e652-27f1-4b26-bbf7-3ae8d8b09e70; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:56 user nova-compute[74721]: DEBUG nova.network.neutron [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "address": "fa:16:3e:e6:2d:ad", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57bb8303-4c", "ovs_interfaceid": "57bb8303-4cf0-4772-99e7-b9fa7d796e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-af3254a5-4c9e-49f0-b376-f2fdf77e2c3c req-5a7c0e1e-dc2e-4e1a-9c90-23805a3f90f9 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Detach interface failed, port_id=a725e652-27f1-4b26-bbf7-3ae8d8b09e70, reason: Instance 373a06ee-b138-4325-b1f5-99e52d5355ad could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-30a96557-cd8e-49d2-8d28-9622b1df304b req-9a024075-1111-4d3c-80a8-03521ab0a709 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Received event network-vif-deleted-57bb8303-4cf0-4772-99e7-b9fa7d796e9f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:01:58 user nova-compute[74721]: INFO nova.compute.manager [req-30a96557-cd8e-49d2-8d28-9622b1df304b req-9a024075-1111-4d3c-80a8-03521ab0a709 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Neutron deleted interface 57bb8303-4cf0-4772-99e7-b9fa7d796e9f; detaching it from the instance and deleting it from the info cache
Nov 02 23:01:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-30a96557-cd8e-49d2-8d28-9622b1df304b req-9a024075-1111-4d3c-80a8-03521ab0a709 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Updating instance_info_cache with network_info: [{"id": "58222433-a0d5-462c-825e-803a15173831", "address": "fa:16:3e:02:fd:51", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58222433-a0", "ovs_interfaceid": "58222433-a0d5-462c-825e-803a15173831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "address": "fa:16:3e:5a:a0:62", "network": {"id": "5dee0947-ec37-465b-8c64-4a6cf5a9c0f6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432773026", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5fbdbbaa0b1c4805960775f6ffb5dcbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dfeee28-de", "ovs_interfaceid": "3dfeee28-dee7-4b73-ad7a-73398fe62b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:01:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-30a96557-cd8e-49d2-8d28-9622b1df304b req-9a024075-1111-4d3c-80a8-03521ab0a709 service nova] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Detach interface failed, port_id=57bb8303-4cf0-4772-99e7-b9fa7d796e9f, reason: Instance 373a06ee-b138-4325-b1f5-99e52d5355ad could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:01:59 user nova-compute[74721]: INFO nova.compute.manager [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Unrescuing
Nov 02 23:01:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:01:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:01:59 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:01:59 user nova-compute[74721]: INFO nova.compute.manager [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] [instance: 373a06ee-b138-4325-b1f5-99e52d5355ad] Took 2.80 seconds to detach 3 volumes for instance.
Nov 02 23:01:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:01:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:01:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'flavor' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:00 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Deleted allocations for instance 373a06ee-b138-4325-b1f5-99e52d5355ad
Nov 02 23:02:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cc4c205-9f5b-419b-97b8-4c45fa08ed0c tempest-TaggedBootDevicesTest_v242-1746374325 tempest-TaggedBootDevicesTest_v242-1746374325-project-member] Lock "373a06ee-b138-4325-b1f5-99e52d5355ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.040s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:00 user nova-compute[74721]: WARNING nova.compute.manager [req-e92fe9c5-4130-429b-a731-898ee686ae04 req-daff192c-d7ac-49cf-9178-9667c7e16716 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing instance network info cache due to event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:02:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance destroyed successfully.
Nov 02 23:02:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated VIF entry in instance network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:02:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4694860c-0456-46ea-9b66-f35b63e118e1 req-0c7d91db-8461-450c-ba25-1369338cf71f service nova] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing instance network info cache due to event network-changed-1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Refreshing network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:02 user nova-compute[74721]: WARNING nova.compute.manager [req-eddee133-19ef-4982-913c-6a5d1cabdf70 req-955fc8fc-e93e-4e47-92ff-09853fd6eb6e service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated VIF entry in instance network info cache for port 1d4d3068-1dfb-4c8f-9162-2d807dc11302. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-277a0fa5-b188-4514-8b50-939c26ddc20b req-173a76e0-5312-4192-8187-2ca8b1d7f4b3 service nova] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b5f658ee-5d02-4128-85ab-6b8d8cfdeb38 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:04 user nova-compute[74721]: WARNING nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state None.
Nov 02 23:02:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:04 user nova-compute[74721]: WARNING nova.compute.manager [req-fa0f215c-f808-4646-a1f6-8f3d65d5a260 req-92e5d288-4809-4a10-a57e-7cd9f750883d service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state None.
Nov 02 23:02:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_power_states {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:07 user nova-compute[74721]: WARNING nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid caf64044-ba11-440c-8bfe-9c279a385350 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid a3acac92-dcc5-424f-81e6-aa5623908271 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f539868-3357-4719-a715-39ab06bf8898" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "caf64044-ba11-440c-8bfe-9c279a385350" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:07 user nova-compute[74721]: INFO nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f539868-3357-4719-a715-39ab06bf8898" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "caf64044-ba11-440c-8bfe-9c279a385350" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:09 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:02:10 user nova-compute[74721]: INFO nova.compute.claims [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Claim successful on node user
Nov 02 23:02:10 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80e598d8-a24f-412f-a083-3de7b0b853b3 is timed out.
Nov 02 23:02:10 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdb from instance 80e598d8-a24f-412f-a083-3de7b0b853b3 from the live domain config.
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYiCGjWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:02:10 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6ec17-32bc-45d6-bcc7-8950b453764b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:02:10 user nova-compute[74721]: No targets found.
Nov 02 23:02:10 user nova-compute[74721]: iSNS:
Nov 02 23:02:10 user nova-compute[74721]: No targets found.
Nov 02 23:02:10 user nova-compute[74721]: STATIC:
Nov 02 23:02:10 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6
Nov 02 23:02:10 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:10 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:10 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:02:10 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:10 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:10 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:02:10 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:10 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:10 user nova-compute[74721]: FIRMWARE:
Nov 02 23:02:10 user nova-compute[74721]: No targets found.
Nov 02 23:02:10 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:02:10 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:02:10 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c550cc0-a090-4a6f-9cc6-2a369d4b85de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[965a8585-b5a1-432e-84ef-e1a47b65c1d0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:10 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243b1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6'): ({'sdm'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Removing single pathed devices sdm {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[56117e8d-4b19-4b5a-9718-db7f4ffb4f0d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f08453-9513-4594-8f01-0a68af2bf841]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flushing IO for device /dev/sdm {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[363fe0a8-6b25-4d25-a375-0586902ef638]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e5198-eea0-4091-80a3-33dfbec3b5ff]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] SCSI volumes sdm have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33a5d6-34ac-4c8a-8275-7ffb09d56c0f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1708fb76-3566-41da-9723-cde449e16b67]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260]
Nov 02 23:02:10 user nova-compute[74721]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6, portal: 172.16.0.220,3260] successful.
Nov 02 23:02:10 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df05287d-23e4-46c6-8726-3dc1d326c8c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8a2f1-ae95-41f7-88c0-ee38e615848f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== disconnect_volume: return (342ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:02:10 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.policy [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ce6a847827d4c68a59c5753c3ce39f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6a0a54ffad484facd7e9c8d9a2c029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:02:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:02:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Creating image(s)
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "/opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "/opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "/opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk 1073741824" returned: 0 in 0.062s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Successfully created port: 71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Cannot resize image /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Ensure instance console log exists: /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Successfully updated port: 71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquired lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-changed-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Refreshing instance network info cache due to event network-changed-71b32ddb-eedb-465d-a62e-07e78cec625f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] Acquiring lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:12 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updating instance_info_cache with network_info: [{"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Releasing lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Instance network_info: |[{"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] Acquired lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Refreshing network info cache for port 71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Start _get_guest_xml network_info=[{"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:02:13 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:02:13 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1300282',id=15,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDf2rJU9+f3GOFgZcghJrlAbiteSej9yMElJzWqTDi5KTF4xXZD0MIphkn1VfpUqUYjdynQnt2hr8RELkeHCrsJB9sRkZu3nmHQI3MVP9eVH1zVbpnpm50SJE5EIv/L8A==',key_name='tempest-keypair-737818048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6a0a54ffad484facd7e9c8d9a2c029',ramdisk_id='',reservation_id='r-6carlhl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce6a847827d4c68a59c5753c3ce39f9',uuid=de639e34-1cd6-4e18-b086-ea4f0303eeb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converting VIF {"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lazy-loading 'pci_devices' on Instance uuid de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:02:13 user nova-compute[74721]:   <uuid>de639e34-1cd6-4e18-b086-ea4f0303eeb6</uuid>
Nov 02 23:02:13 user nova-compute[74721]:   <name>instance-0000000f</name>
Nov 02 23:02:13 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:02:13 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:02:13 user nova-compute[74721]:   <metadata>
Nov 02 23:02:13 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:02:13 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949</nova:name>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:02:13</nova:creationTime>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:02:13 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:02:13 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:owner>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:user uuid="4ce6a847827d4c68a59c5753c3ce39f9">tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member</nova:user>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:project uuid="4f6a0a54ffad484facd7e9c8d9a2c029">tempest-TestServerVolumeAttachScenarioOldVersion-606342397</nova:project>
Nov 02 23:02:13 user nova-compute[74721]:       </nova:owner>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:02:13 user nova-compute[74721]:       <nova:ports>
Nov 02 23:02:13 user nova-compute[74721]:         <nova:port uuid="71b32ddb-eedb-465d-a62e-07e78cec625f">
Nov 02 23:02:13 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:02:13 user nova-compute[74721]:         </nova:port>
Nov 02 23:02:13 user nova-compute[74721]:       </nova:ports>
Nov 02 23:02:13 user nova-compute[74721]:     </nova:instance>
Nov 02 23:02:13 user nova-compute[74721]:   </metadata>
Nov 02 23:02:13 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:02:13 user nova-compute[74721]:     <system>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="serial">de639e34-1cd6-4e18-b086-ea4f0303eeb6</entry>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="uuid">de639e34-1cd6-4e18-b086-ea4f0303eeb6</entry>
Nov 02 23:02:13 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:02:13 user nova-compute[74721]:     </system>
Nov 02 23:02:13 user nova-compute[74721]:   </sysinfo>
Nov 02 23:02:13 user nova-compute[74721]:   <os>
Nov 02 23:02:13 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:02:13 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:02:13 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:02:13 user nova-compute[74721]:   </os>
Nov 02 23:02:13 user nova-compute[74721]:   <features>
Nov 02 23:02:13 user nova-compute[74721]:     <acpi/>
Nov 02 23:02:13 user nova-compute[74721]:     <apic/>
Nov 02 23:02:13 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:02:13 user nova-compute[74721]:   </features>
Nov 02 23:02:13 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:02:13 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:02:13 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:02:13 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:02:13 user nova-compute[74721]:   </clock>
Nov 02 23:02:13 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:02:13 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:02:13 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:02:13 user nova-compute[74721]:   </cpu>
Nov 02 23:02:13 user nova-compute[74721]:   <devices>
Nov 02 23:02:13 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:02:13 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:02:13 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk"/>
Nov 02 23:02:13 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:02:13 user nova-compute[74721]:     </disk>
Nov 02 23:02:13 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:02:13 user nova-compute[74721]:       <mac address="fa:16:3e:eb:fe:c1"/>
Nov 02 23:02:13 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:02:13 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:02:13 user nova-compute[74721]:       <target dev="tap71b32ddb-ee"/>
Nov 02 23:02:13 user nova-compute[74721]:     </interface>
Nov 02 23:02:13 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:02:13 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/console.log" append="off"/>
Nov 02 23:02:13 user nova-compute[74721]:     </serial>
Nov 02 23:02:13 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:02:13 user nova-compute[74721]:     <video>
Nov 02 23:02:13 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:02:13 user nova-compute[74721]:     </video>
Nov 02 23:02:13 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:02:13 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:02:13 user nova-compute[74721]:     </rng>
Nov 02 23:02:13 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:02:13 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:02:13 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:02:13 user nova-compute[74721]:     </memballoon>
Nov 02 23:02:13 user nova-compute[74721]:   </devices>
Nov 02 23:02:13 user nova-compute[74721]: </domain>
Nov 02 23:02:13 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1300282',id=15,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDf2rJU9+f3GOFgZcghJrlAbiteSej9yMElJzWqTDi5KTF4xXZD0MIphkn1VfpUqUYjdynQnt2hr8RELkeHCrsJB9sRkZu3nmHQI3MVP9eVH1zVbpnpm50SJE5EIv/L8A==',key_name='tempest-keypair-737818048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6a0a54ffad484facd7e9c8d9a2c029',ramdisk_id='',reservation_id='r-6carlhl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce6a847827d4c68a59c5753c3ce39f9',uuid=de639e34-1cd6-4e18-b086-ea4f0303eeb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converting VIF {"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG os_vif [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8d49faf-1365-5969-9837-8ccf94eb4cda', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71b32ddb-ee, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71b32ddb-ee, col_values=(('qos', UUID('274b6cd9-63e5-4fa7-b1ea-fdd1a429f321')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71b32ddb-ee, col_values=(('external_ids', {'iface-id': '71b32ddb-eedb-465d-a62e-07e78cec625f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:fe:c1', 'vm-uuid': 'de639e34-1cd6-4e18-b086-ea4f0303eeb6'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:13 user nova-compute[74721]: INFO os_vif [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee')
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] No VIF found with MAC fa:16:3e:eb:fe:c1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updated VIF entry in instance network info cache for port 71b32ddb-eedb-465d-a62e-07e78cec625f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updating instance_info_cache with network_info: [{"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1865ca3e-fda6-4914-97ff-bc84df607c08 req-60b0eee6-0c4e-4c52-99f0-a47f105a73fb service nova] Releasing lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] No waiting events found dispatching network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:14 user nova-compute[74721]: WARNING nova.compute.manager [req-2a672c58-24ab-4442-88a3-2768373e7c04 req-9fbaf72e-1bea-405a-babf-ef9380cb409b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received unexpected event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f for instance with vm_state building and task_state spawning.
Nov 02 23:02:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] No waiting events found dispatching network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:17 user nova-compute[74721]: WARNING nova.compute.manager [req-bb3edf5c-a87e-4a8c-8b3d-d516a5556f13 req-d2dd4828-dda7-466e-901f-a5a00c8ff75b service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received unexpected event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f for instance with vm_state building and task_state spawning.
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:02:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Instance spawned successfully.
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:17 user nova-compute[74721]: INFO nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-401cb10d-53ec-4de2-838d-6c491c90a7a6 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.999s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.996s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:17 user nova-compute[74721]: INFO nova.compute.manager [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Took 7.52 seconds to build instance.
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-34a867c5-f2b8-495d-abf3-39854d905a95 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.636s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:02:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Creating image(s)
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk 1073741824" returned: 0 in 0.064s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74721) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Cannot resize image /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Ensure instance console log exists: /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start _get_guest_xml network_info=[{"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': 'adde52d2-e49f-40ba-92c0-f8923fa43f32', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28634ace-efa2-45a1-bbd9-9bb3f29bef01', 'attached_at': '', 'detached_at': '', 'volume_id': '2d05853f-583d-4eab-b2cf-db8333787930', 'serial': '2d05853f-583d-4eab-b2cf-db8333787930'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:18 user nova-compute[74721]: WARNING nova.compute.manager [req-c20090c2-d8cc-4c59-a248-13fb6f421b22 req-c610ea3e-360f-4406-873f-b6846b5ab8ad service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state powering-off.
Nov 02 23:02:18 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 23:02:18 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.objects.instance [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:02:18 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:02:18 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:02:18 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab843dd3-9a7b-4baa-ac59-96c0d083b8d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:02:18 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ebb7cf-6e9a-436d-a7a7-a8d9537cd246]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930] added
Nov 02 23:02:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e0c04-fe52-43d5-8496-0b54b37ed3da]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af353343-17fa-466e-bfd3-0ffdcff169a1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuaspfZV {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuaspfZV" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62cb29-155c-492b-9b93-41211c6a89f5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuaspfZV'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e345c-1974-4ca4-bf9f-4393dc982ed0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9413d22e-c3b7-4ab6-bd25-d77573d916da]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:18 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:18 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:02:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance destroyed successfully.
Nov 02 23:02:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:02:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fd0e7bfa-fffc-4c40-850a-8666c5a48440 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.968s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --login" returned: 0 in 1.083s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3eba29-fe3b-4524-83d9-f6ae107a55c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]
Nov 02 23:02:20 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.
Nov 02 23:02:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2595aed9-031e-47fb-9a52-60b4c2b7aa65]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927adcb-fc7b-4960-af1d-3de826d72a06]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.358s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ab7f4-c945-4344-99f4-7cf89c289917]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:20 user nova-compute[74721]: WARNING nova.compute.manager [req-17b34188-11d3-47ce-abc9-6d531bda359b req-68f191a7-d9a6-474d-8e10-a26800fbb116 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state None.
Nov 02 23:02:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.406s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== connect_volume: return (2408ms) {'type': 'block', 'scsi_wwn': '26663643261393333', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663643261393333', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-ServerActionsTestOtherA-server-1950633378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:02:21 user nova-compute[74721]:   <uuid>28634ace-efa2-45a1-bbd9-9bb3f29bef01</uuid>
Nov 02 23:02:21 user nova-compute[74721]:   <name>instance-0000000c</name>
Nov 02 23:02:21 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:02:21 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:02:21 user nova-compute[74721]:   <metadata>
Nov 02 23:02:21 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:02:21 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherA-server-1950633378</nova:name>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:02:18</nova:creationTime>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:02:21 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:02:21 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:owner>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:user uuid="2d3fb4cd21c349a1b60f075ffa63f393">tempest-ServerActionsTestOtherA-756381715-project-member</nova:user>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:project uuid="8d9ed314de1541b6854e6158ee0816a0">tempest-ServerActionsTestOtherA-756381715</nova:project>
Nov 02 23:02:21 user nova-compute[74721]:       </nova:owner>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:02:21 user nova-compute[74721]:       <nova:ports>
Nov 02 23:02:21 user nova-compute[74721]:         <nova:port uuid="8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc">
Nov 02 23:02:21 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:02:21 user nova-compute[74721]:         </nova:port>
Nov 02 23:02:21 user nova-compute[74721]:       </nova:ports>
Nov 02 23:02:21 user nova-compute[74721]:     </nova:instance>
Nov 02 23:02:21 user nova-compute[74721]:   </metadata>
Nov 02 23:02:21 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:02:21 user nova-compute[74721]:     <system>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="serial">28634ace-efa2-45a1-bbd9-9bb3f29bef01</entry>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="uuid">28634ace-efa2-45a1-bbd9-9bb3f29bef01</entry>
Nov 02 23:02:21 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:02:21 user nova-compute[74721]:     </system>
Nov 02 23:02:21 user nova-compute[74721]:   </sysinfo>
Nov 02 23:02:21 user nova-compute[74721]:   <os>
Nov 02 23:02:21 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:02:21 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:02:21 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:02:21 user nova-compute[74721]:   </os>
Nov 02 23:02:21 user nova-compute[74721]:   <features>
Nov 02 23:02:21 user nova-compute[74721]:     <acpi/>
Nov 02 23:02:21 user nova-compute[74721]:     <apic/>
Nov 02 23:02:21 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:02:21 user nova-compute[74721]:   </features>
Nov 02 23:02:21 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:02:21 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:02:21 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:02:21 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:02:21 user nova-compute[74721]:   </clock>
Nov 02 23:02:21 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:02:21 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:02:21 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:02:21 user nova-compute[74721]:   </cpu>
Nov 02 23:02:21 user nova-compute[74721]:   <devices>
Nov 02 23:02:21 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:02:21 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:02:21 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk"/>
Nov 02 23:02:21 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:02:21 user nova-compute[74721]:     </disk>
Nov 02 23:02:21 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:02:21 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:02:21 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:02:21 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:02:21 user nova-compute[74721]:       <serial>2d05853f-583d-4eab-b2cf-db8333787930</serial>
Nov 02 23:02:21 user nova-compute[74721]:     </disk>
Nov 02 23:02:21 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:02:21 user nova-compute[74721]:       <mac address="fa:16:3e:3b:45:fe"/>
Nov 02 23:02:21 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:02:21 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:02:21 user nova-compute[74721]:       <target dev="tap8a7c3d26-0a"/>
Nov 02 23:02:21 user nova-compute[74721]:     </interface>
Nov 02 23:02:21 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:02:21 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/console.log" append="off"/>
Nov 02 23:02:21 user nova-compute[74721]:     </serial>
Nov 02 23:02:21 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:02:21 user nova-compute[74721]:     <video>
Nov 02 23:02:21 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:02:21 user nova-compute[74721]:     </video>
Nov 02 23:02:21 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:02:21 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:02:21 user nova-compute[74721]:     </rng>
Nov 02 23:02:21 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:02:21 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:02:21 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:02:21 user nova-compute[74721]:     </memballoon>
Nov 02 23:02:21 user nova-compute[74721]:   </devices>
Nov 02 23:02:21 user nova-compute[74721]: </domain>
Nov 02 23:02:21 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-ServerActionsTestOtherA-server-1950633378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG os_vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1931d4ca-30e7-56f7-939f-6ae113da3d91', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a7c3d26-0a, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a7c3d26-0a, col_values=(('qos', UUID('7d60f383-7ab5-449d-ae25-f96ef71e048f')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a7c3d26-0a, col_values=(('external_ids', {'iface-id': '8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:45:fe', 'vm-uuid': '28634ace-efa2-45a1-bbd9-9bb3f29bef01'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:21 user nova-compute[74721]: INFO os_vif [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a')
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:02:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:3b:45:fe, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:02:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:22 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:23 user nova-compute[74721]: WARNING nova.compute.manager [req-f5ac4d64-cc70-44ce-91f0-32d63cf093cd req-63c0deac-8806-4b70-8b97-b29300e377ba service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state active and task_state rebuild_spawning.
Nov 02 23:02:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:24 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:02:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:25 user nova-compute[74721]: WARNING nova.compute.manager [req-5cfd45db-de59-446e-a3c7-5e4e6b62cd85 req-97b4b213-324c-44db-b805-7336fb61dcc5 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state active and task_state rebuild_spawning.
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:02:25 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance spawned successfully.
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.objects.instance [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74721) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-156364b0-88a1-4ae2-9018-165188a23ff8 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [{"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-2bd27de5-1593-4d0e-981a-766ca5bc052a" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:02:25 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:26 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Port e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd binding to destination host user is already ACTIVE {{(pid=74721) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 23:02:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:26 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Creating tmpfile /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/tmpguej4vrx to verify with other compute node that the instance is on the same shared storage. {{(pid=74721) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:27 user nova-compute[74721]: WARNING nova.compute.manager [req-c1bbf713-7fff-4f64-9a9b-f04ce1945ed6 req-82ebcb74-2b90-4d9b-9788-238e03e22ba0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state resized and task_state resize_reverting.
Nov 02 23:02:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance destroyed successfully.
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'resources' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4d474-9e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34784b95-c88b-45b5-a264-1ab3377740b1) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:28 user nova-compute[74721]: INFO os_vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:02:28 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f79d4-0f7a-4ae7-b8e6-041a755cd7e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:02:28 user nova-compute[74721]: No targets found.
Nov 02 23:02:28 user nova-compute[74721]: iSNS:
Nov 02 23:02:28 user nova-compute[74721]: No targets found.
Nov 02 23:02:28 user nova-compute[74721]: STATIC:
Nov 02 23:02:28 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:02:28 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:28 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:28 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:02:28 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:28 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:28 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:02:28 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:28 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:28 user nova-compute[74721]: FIRMWARE:
Nov 02 23:02:28 user nova-compute[74721]: No targets found.
Nov 02 23:02:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:02:28 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:02:28 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1682dd10-9fd5-481d-b6ba-ea793138d637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd404b6-977a-4c8e-aa1c-d0eb77178b45]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2414d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d80f59-f8f7-472c-8044-79a92d9d9e5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a33ab75-fa0e-48e9-9a9a-03a76b601a96]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd64b2d-471c-4805-92ca-e04df664a634]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d44fbe-575d-4e95-9432-44c10306aba5]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea5844b-f8a6-4acd-9ecb-80a48729d214]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c449168-280d-4263-b0eb-4105411f6ef4]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:02:28 user nova-compute[74721]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:02:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2310b28-004f-49e4-9122-424a1e7c8b4c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== disconnect_volume: return (410ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:02:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:02:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:02:30 user nova-compute[74721]: WARNING nova.compute.manager [req-55cb552e-0aac-4c45-a10c-17c5d2c44d4e req-7f79c18d-1e8b-4fde-a9ea-22a6086ce754 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state resized and task_state resize_reverting.
Nov 02 23:02:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:32 user nova-compute[74721]: INFO nova.compute.manager [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Detaching volume b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:02:32 user nova-compute[74721]: INFO nova.virt.block_device [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Attempting to driver detach volume b98da9af-12db-4295-87d7-fbd1b0314551 from mountpoint /dev/vdb
Nov 02 23:02:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Attempting to detach device vdb from instance 2bd27de5-1593-4d0e-981a-766ca5bc052a from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:02:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:02:32 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:02:32 user nova-compute[74721]:   <source dev="/dev/sdn"/>
Nov 02 23:02:32 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:02:32 user nova-compute[74721]:   <serial>b98da9af-12db-4295-87d7-fbd1b0314551</serial>
Nov 02 23:02:32 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:02:32 user nova-compute[74721]: </disk>
Nov 02 23:02:32 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:02:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Successfully detached device vdb from instance 2bd27de5-1593-4d0e-981a-766ca5bc052a from the persistent domain config.
Nov 02 23:02:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bd27de5-1593-4d0e-981a-766ca5bc052a from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:02:33 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:02:33 user nova-compute[74721]:   <source dev="/dev/sdn"/>
Nov 02 23:02:33 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:02:33 user nova-compute[74721]:   <serial>b98da9af-12db-4295-87d7-fbd1b0314551</serial>
Nov 02 23:02:33 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:02:33 user nova-compute[74721]: </disk>
Nov 02 23:02:33 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:33 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'migration_context' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:34 user nova-compute[74721]: DEBUG nova.objects.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Object Instance<bb70b80b-ebf8-4962-afa2-49de93c5b3af> lazy-loaded attributes: resources,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.768s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:35 user nova-compute[74721]: INFO nova.compute.manager [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Swapping old allocation on dict_keys(['ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b']) held by migration 1625457d-0281-461f-b038-302d92c545e6 for instance
Nov 02 23:02:35 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Overwriting current allocation {'allocations': {'ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': '2fc43b8d380f489291403f7300e9a48c', 'user_id': '821e324c9ed4485dbb9fd3d2200b6427', 'consumer_generation': 1} on consumer bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:02:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.utils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b90149-f739-4ec8-bb47-6ff9603491c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dad817-ed7a-4b93-bcf0-c7b073f34e39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7991c-60d2-4fc9-a2e1-ac05ad8628c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[009bef50-9e69-4a76-a805-c7940ca10fff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:02:36 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:02:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa90d01-c69b-4915-b796-1d1bc0f127d2]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:02:36 user nova-compute[74721]: DEBUG os_brick.utils [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:02:38 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:02:38 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.395668029785156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2bd27de5-1593-4d0e-981a-766ca5bc052a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance caf64044-ba11-440c-8bfe-9c279a385350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance a3acac92-dcc5-424f-81e6-aa5623908271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:02:38 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:02:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:02:39 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:02:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:02:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bd27de5-1593-4d0e-981a-766ca5bc052a is timed out.
Nov 02 23:02:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Successfully detached device vdb from instance 2bd27de5-1593-4d0e-981a-766ca5bc052a from the live domain config.
Nov 02 23:02:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiKuYkdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdn'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:02:53 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea24ed-326a-4c16-8d96-0d6bf3d6e223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:02:53 user nova-compute[74721]: No targets found.
Nov 02 23:02:53 user nova-compute[74721]: iSNS:
Nov 02 23:02:53 user nova-compute[74721]: No targets found.
Nov 02 23:02:53 user nova-compute[74721]: STATIC:
Nov 02 23:02:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:02:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551
Nov 02 23:02:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:02:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:02:53 user nova-compute[74721]: FIRMWARE:
Nov 02 23:02:53 user nova-compute[74721]: No targets found.
Nov 02 23:02:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:02:53 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:02:53 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9de13-7ef1-400d-81c7-24de41efa122]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2b7c16-d295-4988-bca1-47d615afe760]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:53 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 (non-flash)
Nov 02 23:02:53 user nova-compute[74721]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:02:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24170670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551'): ({'sdn'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Removing single pathed devices sdn {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92b197b-5595-4303-a0c7-89676b7c8ded]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdn" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b27d46-dfc8-41c8-9c61-3c01d19c4126]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Flushing IO for device /dev/sdn {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:02:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdn" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b256cb-65a1-494f-850f-3da3bb97210f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdn/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdn/device/delete" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e2eb6a-e0a6-4a3d-8ddc-b4d227cc20d5]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Checking to see if SCSI volumes sdn have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] SCSI volumes sdn have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[87841601-9101-4d5f-9364-e8dac2a7eb42]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1202087c-d54c-4fc7-ba9b-6721c957e002]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260]
Nov 02 23:02:54 user nova-compute[74721]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551, portal: 172.16.0.220,3260] successful.
Nov 02 23:02:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98da9af-12db-4295-87d7-fbd1b0314551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf9dd8-14c8-478a-bc5b-d8950c43cdc3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] <== disconnect_volume: return (352ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:02:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:55 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'flavor' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:02:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ab9c06b5-f862-43e3-ae7d-65ad5f856e48 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.375s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:02:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:02:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:04 user nova-compute[74721]: INFO nova.compute.manager [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Terminating instance
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-unplugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] No waiting events found dispatching network-vif-unplugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6829c59-a3cf-496e-b5a2-1d8b694a49bd req-bdec6007-b189-4e95-9ae4-d9065df44c73 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-unplugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Instance destroyed successfully.
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'resources' on Instance uuid caf64044-ba11-440c-8bfe-9c279a385350 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1386843645',display_name='tempest-VolumesAdminNegativeTest-server-1386843645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1386843645',id=13,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-hg966llc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:00:35Z,user_data=None,user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=caf64044-ba11-440c-8bfe-9c279a385350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "address": "fa:16:3e:7f:80:7a", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f7518c-32", "ovs_interfaceid": "04f7518c-3291-4dd7-b6e3-77e5dc8256f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG os_vif [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04f7518c-32, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71836188-8563-4869-bc1d-7db11839e09d) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:04 user nova-compute[74721]: INFO os_vif [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:80:7a,bridge_name='br-int',has_traffic_filtering=True,id=04f7518c-3291-4dd7-b6e3-77e5dc8256f0,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f7518c-32')
Nov 02 23:03:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Deleting instance files /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350_del
Nov 02 23:03:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Deletion of /opt/stack/data/nova/instances/caf64044-ba11-440c-8bfe-9c279a385350_del complete
Nov 02 23:03:05 user nova-compute[74721]: INFO nova.compute.manager [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 02 23:03:05 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:05 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Took 0.56 seconds to deallocate network for instance.
Nov 02 23:03:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:03:05 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:06 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Deleted allocations for instance caf64044-ba11-440c-8bfe-9c279a385350
Nov 02 23:03:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1c132cf8-b167-4bcd-91fd-8e59f68956c5 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "caf64044-ba11-440c-8bfe-9c279a385350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] Acquiring lock "caf64044-ba11-440c-8bfe-9c279a385350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] Lock "caf64044-ba11-440c-8bfe-9c279a385350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] No waiting events found dispatching network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:06 user nova-compute[74721]: WARNING nova.compute.manager [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received unexpected event network-vif-plugged-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 for instance with vm_state deleted and task_state None.
Nov 02 23:03:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-24887c57-4db5-48e4-9105-0f9009c4a852 req-a10fcec4-d68d-468e-87a6-8eb0f4a07751 service nova] [instance: caf64044-ba11-440c-8bfe-9c279a385350] Received event network-vif-deleted-04f7518c-3291-4dd7-b6e3-77e5dc8256f0 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:03:14 user nova-compute[74721]: INFO nova.compute.claims [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Claim successful on node user
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:03:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.policy [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ba59bab70c94cdab38eb64b0774e559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e30ac1b4346489c46c6490e3bcc81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:03:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Creating image(s)
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "/opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "/opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "/opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Successfully created port: c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk 1073741824" returned: 0 in 0.062s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Cannot resize image /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Ensure instance console log exists: /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Successfully updated port: c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquired lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-changed-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Refreshing instance network info cache due to event network-changed-c54158bb-77eb-4c50-abba-922bfd18ecea. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] Acquiring lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updating instance_info_cache with network_info: [{"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Releasing lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Instance network_info: |[{"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] Acquired lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Refreshing network info cache for port c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Start _get_guest_xml network_info=[{"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:03:16 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:16 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-493728230',display_name='tempest-DeleteServersTestJSON-server-493728230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-493728230',id=16,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='538e30ac1b4346489c46c6490e3bcc81',ramdisk_id='',reservation_id='r-pjd57ut5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-165672183',owner_user_name='tempest-DeleteServersTestJSON-165672183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:03:15Z,user_data=None,user_id='0ba59bab70c94cdab38eb64b0774e559',uuid=b91ab94a-82ca-45c9-84b8-b2d28eae9a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converting VIF {"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lazy-loading 'pci_devices' on Instance uuid b91ab94a-82ca-45c9-84b8-b2d28eae9a72 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:03:16 user nova-compute[74721]:   <uuid>b91ab94a-82ca-45c9-84b8-b2d28eae9a72</uuid>
Nov 02 23:03:16 user nova-compute[74721]:   <name>instance-00000010</name>
Nov 02 23:03:16 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:03:16 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:03:16 user nova-compute[74721]:   <metadata>
Nov 02 23:03:16 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:03:16 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:name>tempest-DeleteServersTestJSON-server-493728230</nova:name>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:03:16</nova:creationTime>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:03:16 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:03:16 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:owner>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:user uuid="0ba59bab70c94cdab38eb64b0774e559">tempest-DeleteServersTestJSON-165672183-project-member</nova:user>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:project uuid="538e30ac1b4346489c46c6490e3bcc81">tempest-DeleteServersTestJSON-165672183</nova:project>
Nov 02 23:03:16 user nova-compute[74721]:       </nova:owner>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:03:16 user nova-compute[74721]:       <nova:ports>
Nov 02 23:03:16 user nova-compute[74721]:         <nova:port uuid="c54158bb-77eb-4c50-abba-922bfd18ecea">
Nov 02 23:03:16 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 23:03:16 user nova-compute[74721]:         </nova:port>
Nov 02 23:03:16 user nova-compute[74721]:       </nova:ports>
Nov 02 23:03:16 user nova-compute[74721]:     </nova:instance>
Nov 02 23:03:16 user nova-compute[74721]:   </metadata>
Nov 02 23:03:16 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:03:16 user nova-compute[74721]:     <system>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="serial">b91ab94a-82ca-45c9-84b8-b2d28eae9a72</entry>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="uuid">b91ab94a-82ca-45c9-84b8-b2d28eae9a72</entry>
Nov 02 23:03:16 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:03:16 user nova-compute[74721]:     </system>
Nov 02 23:03:16 user nova-compute[74721]:   </sysinfo>
Nov 02 23:03:16 user nova-compute[74721]:   <os>
Nov 02 23:03:16 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:03:16 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:03:16 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:03:16 user nova-compute[74721]:   </os>
Nov 02 23:03:16 user nova-compute[74721]:   <features>
Nov 02 23:03:16 user nova-compute[74721]:     <acpi/>
Nov 02 23:03:16 user nova-compute[74721]:     <apic/>
Nov 02 23:03:16 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:03:16 user nova-compute[74721]:   </features>
Nov 02 23:03:16 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:03:16 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:03:16 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:03:16 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:03:16 user nova-compute[74721]:   </clock>
Nov 02 23:03:16 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:03:16 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:03:16 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:03:16 user nova-compute[74721]:   </cpu>
Nov 02 23:03:16 user nova-compute[74721]:   <devices>
Nov 02 23:03:16 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:03:16 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:03:16 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk"/>
Nov 02 23:03:16 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:03:16 user nova-compute[74721]:     </disk>
Nov 02 23:03:16 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:03:16 user nova-compute[74721]:       <mac address="fa:16:3e:cf:b6:4b"/>
Nov 02 23:03:16 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:16 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:03:16 user nova-compute[74721]:       <target dev="tapc54158bb-77"/>
Nov 02 23:03:16 user nova-compute[74721]:     </interface>
Nov 02 23:03:16 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:03:16 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/console.log" append="off"/>
Nov 02 23:03:16 user nova-compute[74721]:     </serial>
Nov 02 23:03:16 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:03:16 user nova-compute[74721]:     <video>
Nov 02 23:03:16 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:16 user nova-compute[74721]:     </video>
Nov 02 23:03:16 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:03:16 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:03:16 user nova-compute[74721]:     </rng>
Nov 02 23:03:16 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:03:16 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:03:16 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:03:16 user nova-compute[74721]:     </memballoon>
Nov 02 23:03:16 user nova-compute[74721]:   </devices>
Nov 02 23:03:16 user nova-compute[74721]: </domain>
Nov 02 23:03:16 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-493728230',display_name='tempest-DeleteServersTestJSON-server-493728230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-493728230',id=16,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='538e30ac1b4346489c46c6490e3bcc81',ramdisk_id='',reservation_id='r-pjd57ut5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-165672183',owner_user_name='tempest-DeleteServersTestJSON-165672183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:03:15Z,user_data=None,user_id='0ba59bab70c94cdab38eb64b0774e559',uuid=b91ab94a-82ca-45c9-84b8-b2d28eae9a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converting VIF {"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG os_vif [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86cecaad-ebc6-5c54-8c58-78e1d9f03bc2', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc54158bb-77, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc54158bb-77, col_values=(('qos', UUID('aba6ea69-448f-42a3-9605-39169ccc0c3b')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc54158bb-77, col_values=(('external_ids', {'iface-id': 'c54158bb-77eb-4c50-abba-922bfd18ecea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:b6:4b', 'vm-uuid': 'b91ab94a-82ca-45c9-84b8-b2d28eae9a72'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:16 user nova-compute[74721]: INFO os_vif [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77')
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] No VIF found with MAC fa:16:3e:cf:b6:4b, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updated VIF entry in instance network info cache for port c54158bb-77eb-4c50-abba-922bfd18ecea. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG nova.network.neutron [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updating instance_info_cache with network_info: [{"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-922b4e29-3ed7-4700-82e8-d8ab57fe01d2 req-2b492aae-8015-4f7c-b52c-ece5d34d98e0 service nova] Releasing lock "refresh_cache-b91ab94a-82ca-45c9-84b8-b2d28eae9a72" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] No waiting events found dispatching network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:18 user nova-compute[74721]: WARNING nova.compute.manager [req-9faa454c-98aa-4a9e-86d3-8a6de2dfc134 req-b7f5fecf-6755-48e4-af27-e4b398913cfc service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received unexpected event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea for instance with vm_state building and task_state spawning.
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] No waiting events found dispatching network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:20 user nova-compute[74721]: WARNING nova.compute.manager [req-5bdfb790-9951-440a-8d96-ea0467b46a5a req-be306f35-d1f5-4f0c-ab8b-12782e768a12 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received unexpected event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea for instance with vm_state building and task_state spawning.
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:03:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Instance spawned successfully.
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:20 user nova-compute[74721]: INFO nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 02 23:03:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:03:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:20 user nova-compute[74721]: INFO nova.compute.manager [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Took 6.49 seconds to build instance.
Nov 02 23:03:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbf7e4c5-5e51-458e-a319-34b3b76dbde9 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.608s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Starting finish_revert_migration {{(pid=74721) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start _get_guest_xml network_info=[{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': 'd9b844dd-feee-458f-89c5-f8339c6644c9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb70b80b-ebf8-4962-afa2-49de93c5b3af', 'attached_at': '2023-11-02T23:03:23.000000', 'detached_at': '', 'volume_id': '0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'serial': '0d3e374a-a466-4f4f-90d5-8ca9f921cf71'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:03:23 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:23 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:03:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:03:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:03:23 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b115f-a012-4e94-a7fb-5097d52cdfeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:03:23 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6c246-f1c9-4a04-8ba3-33f5579ad6f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71] added
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c1ec70-fce9-4e43-b7e2-e73792fca307]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8e95c1-0125-46ad-80ef-856dea80f210]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqvZMEri" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4a87e-b954-4497-b841-09161e2c8ed7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqvZMEri'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fb6a1-d4ea-40bd-affb-f9b797b3c80c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7338cbb-4386-42e7-8c15-41d5988b463c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b95b7c-a4b3-48d9-a9a9-db2d7112108d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:03:23 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[13488846-feae-484d-9664-93842e575dec]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[17268f5e-7da7-4db3-a7ab-eaf3ffd6dc37]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c490d66b-fa75-42e9-9423-904dc5b85655]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:23 user nova-compute[74721]: INFO nova.compute.manager [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Terminating instance
Nov 02 23:03:23 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-4dfcba3c-eeff-4f2b-b99d-7c6b2faed4f9 req-429ace34-ef43-448e-b721-84e5f4a39cda service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-unplugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646130313963', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:03:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Instance destroyed successfully.
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lazy-loading 'resources' on Instance uuid 2bd27de5-1593-4d0e-981a-766ca5bc052a {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:03:24 user nova-compute[74721]:   <uuid>bb70b80b-ebf8-4962-afa2-49de93c5b3af</uuid>
Nov 02 23:03:24 user nova-compute[74721]:   <name>instance-00000002</name>
Nov 02 23:03:24 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:03:24 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:03:24 user nova-compute[74721]:   <metadata>
Nov 02 23:03:24 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:03:24 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherB-server-639869915</nova:name>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:03:23</nova:creationTime>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:03:24 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:03:24 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:owner>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:user uuid="821e324c9ed4485dbb9fd3d2200b6427">tempest-ServerActionsTestOtherB-371613091-project-member</nova:user>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:project uuid="2fc43b8d380f489291403f7300e9a48c">tempest-ServerActionsTestOtherB-371613091</nova:project>
Nov 02 23:03:24 user nova-compute[74721]:       </nova:owner>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:03:24 user nova-compute[74721]:       <nova:ports>
Nov 02 23:03:24 user nova-compute[74721]:         <nova:port uuid="e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd">
Nov 02 23:03:24 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:03:24 user nova-compute[74721]:         </nova:port>
Nov 02 23:03:24 user nova-compute[74721]:       </nova:ports>
Nov 02 23:03:24 user nova-compute[74721]:     </nova:instance>
Nov 02 23:03:24 user nova-compute[74721]:   </metadata>
Nov 02 23:03:24 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:03:24 user nova-compute[74721]:     <system>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="serial">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="uuid">bb70b80b-ebf8-4962-afa2-49de93c5b3af</entry>
Nov 02 23:03:24 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:03:24 user nova-compute[74721]:     </system>
Nov 02 23:03:24 user nova-compute[74721]:   </sysinfo>
Nov 02 23:03:24 user nova-compute[74721]:   <os>
Nov 02 23:03:24 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:03:24 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:03:24 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:03:24 user nova-compute[74721]:   </os>
Nov 02 23:03:24 user nova-compute[74721]:   <features>
Nov 02 23:03:24 user nova-compute[74721]:     <acpi/>
Nov 02 23:03:24 user nova-compute[74721]:     <apic/>
Nov 02 23:03:24 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:03:24 user nova-compute[74721]:   </features>
Nov 02 23:03:24 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:03:24 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:03:24 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:03:24 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:03:24 user nova-compute[74721]:   </clock>
Nov 02 23:03:24 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:03:24 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:03:24 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:03:24 user nova-compute[74721]:   </cpu>
Nov 02 23:03:24 user nova-compute[74721]:   <devices>
Nov 02 23:03:24 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:03:24 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:03:24 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk"/>
Nov 02 23:03:24 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:03:24 user nova-compute[74721]:     </disk>
Nov 02 23:03:24 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:03:24 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:03:24 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:03:24 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:03:24 user nova-compute[74721]:       <serial>0d3e374a-a466-4f4f-90d5-8ca9f921cf71</serial>
Nov 02 23:03:24 user nova-compute[74721]:     </disk>
Nov 02 23:03:24 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:03:24 user nova-compute[74721]:       <mac address="fa:16:3e:04:f7:98"/>
Nov 02 23:03:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:24 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:03:24 user nova-compute[74721]:       <target dev="tape4e4d474-9e"/>
Nov 02 23:03:24 user nova-compute[74721]:     </interface>
Nov 02 23:03:24 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:03:24 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/console.log" append="off"/>
Nov 02 23:03:24 user nova-compute[74721]:     </serial>
Nov 02 23:03:24 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:03:24 user nova-compute[74721]:     <video>
Nov 02 23:03:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:24 user nova-compute[74721]:     </video>
Nov 02 23:03:24 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:03:24 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:03:24 user nova-compute[74721]:     </rng>
Nov 02 23:03:24 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:03:24 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:03:24 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:03:24 user nova-compute[74721]:     </memballoon>
Nov 02 23:03:24 user nova-compute[74721]:   </devices>
Nov 02 23:03:24 user nova-compute[74721]: </domain>
Nov 02 23:03:24 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG os_vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1030411833',display_name='tempest-ServerStableDeviceRescueTest-server-1030411833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1030411833',id=1,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNIZDD8fSNOHfbgmvPWgQYpuaaFUt9Y9aHT0Ls1/1zORqHXG2VLjhoJgSljiBLih0CzZJOocC8cPPiKkVNHaXqEfB8yvxOL1648swx/iSRx+hKVxo6dqgFdibBckJG9aQ==',key_name='tempest-keypair-593836985',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d1f14597a747e7861bd5804f741326',ramdisk_id='',reservation_id='r-a3o4h2d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1520146931',owner_user_name='tempest-ServerStableDeviceRescueTest-1520146931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9bbcabb56f4e58b533c7249824bfc6',uuid=2bd27de5-1593-4d0e-981a-766ca5bc052a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converting VIF {"id": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "address": "fa:16:3e:cc:97:7f", "network": {"id": "ea20aba0-2a23-4c99-a4e5-84f972f349fc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1985457561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1f14597a747e7861bd5804f741326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4d3068-1d", "ovs_interfaceid": "1d4d3068-1dfb-4c8f-9162-2d807dc11302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG os_vif [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25be48b0-36bf-5e38-83b4-c5aa20750405', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4d3068-1d, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4d474-9e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4e4d474-9e, col_values=(('qos', UUID('95c49b4f-e250-479d-8060-4c1352f0d768')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4e4d474-9e, col_values=(('external_ids', {'iface-id': 'e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f7:98', 'vm-uuid': 'bb70b80b-ebf8-4962-afa2-49de93c5b3af'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: INFO os_vif [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b6fdd86-58c9-490c-9785-fd9a6d06e0ea) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:24 user nova-compute[74721]: INFO os_vif [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:97:7f,bridge_name='br-int',has_traffic_filtering=True,id=1d4d3068-1dfb-4c8f-9162-2d807dc11302,network=Network(ea20aba0-2a23-4c99-a4e5-84f972f349fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4d3068-1d')
Nov 02 23:03:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Deleting instance files /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a_del
Nov 02 23:03:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Deletion of /opt/stack/data/nova/instances/2bd27de5-1593-4d0e-981a-766ca5bc052a_del complete
Nov 02 23:03:25 user nova-compute[74721]: INFO nova.compute.manager [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 23:03:25 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:03:25 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:03:25 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:03:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:03:26 user nova-compute[74721]: INFO nova.compute.claims [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Claim successful on node user
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] Acquiring lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] No waiting events found dispatching network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:26 user nova-compute[74721]: WARNING nova.compute.manager [req-7ac7aa6a-f9ad-4fff-a958-7cc1a05fec3c req-a703fa56-f28b-4cf4-aae5-6c8e8ebd11f5 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received unexpected event network-vif-plugged-1d4d3068-1dfb-4c8f-9162-2d807dc11302 for instance with vm_state active and task_state deleting.
Nov 02 23:03:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:26 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Took 1.51 seconds to deallocate network for instance.
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-384190f8-3529-4e12-b12f-b23f56eb7d14 req-2f7e734c-14f5-42e8-8c4b-c8ac594482b7 service nova] [instance: 2bd27de5-1593-4d0e-981a-766ca5bc052a] Received event network-vif-deleted-1d4d3068-1dfb-4c8f-9162-2d807dc11302 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:26 user nova-compute[74721]: WARNING nova.compute.manager [req-9423032d-b7e8-4538-a15e-41f7e68287be req-4ed0f5da-7ddb-43ab-a99a-94cd416255d0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state resized and task_state resize_reverting.
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:03:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.058s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:03:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.policy [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2979ae9ac194589921de6ba94e576d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a31f16591d4189bd728b4d69175796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:03:27 user nova-compute[74721]: INFO nova.virt.block_device [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Booting with volume e3a8516e-8593-40fb-a8cf-8d35b64ed56b at /dev/vda
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.utils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b6c18-0a8c-445e-8093-f0d9faa6c192]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[26611bc0-6e85-46ab-b2ac-e03f26cd660a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9be3e-0fc8-402c-959d-ca8e8f788c04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6e908-1063-449f-bb09-b5ecba457cc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.680s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:03:27 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e8e1a-ac56-4eed-acc1-a7059f9e2ed4]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG os_brick.utils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:03:27 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating existing volume attachment record: 93078cc6-422f-4b44-a385-58d9bbbeb44c {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:03:27 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Deleted allocations for instance 2bd27de5-1593-4d0e-981a-766ca5bc052a
Nov 02 23:03:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3c2fd6e-7375-4bf8-acd3-3d02acd0eff4 tempest-ServerStableDeviceRescueTest-1520146931 tempest-ServerStableDeviceRescueTest-1520146931-project-member] Lock "2bd27de5-1593-4d0e-981a-766ca5bc052a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Successfully created port: 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:03:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:29 user nova-compute[74721]: WARNING nova.compute.manager [req-069508a8-1f2e-4ba3-9e0e-8dfe8cb9437c req-0179d821-ca1a-4a34-acf9-a30d59a691a2 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state resized and task_state resize_reverting.
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Successfully updated port: 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquired lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [{"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-changed-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Refreshing instance network info cache due to event network-changed-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] Acquiring lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-bb70b80b-ebf8-4962-afa2-49de93c5b3af" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:03:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance running successfully.
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] finish_revert_migration finished successfully. {{(pid=74721) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating instance_info_cache with network_info: [{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Releasing lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance network_info: |[{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] Acquired lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Refreshing network info cache for port 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:03:29 user nova-compute[74721]: INFO nova.compute.manager [None req-4f90daef-d9a2-450e-8fb9-ea6de69b3181 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance to original state: 'active'
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updated VIF entry in instance network info cache for port 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating instance_info_cache with network_info: [{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:03:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f9b6cead-025d-49c1-b8b9-6067aa30f21e req-7c52d32b-b435-4622-81bf-395ed282219f service nova] Releasing lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:03:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:35 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.505897521972656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance a3acac92-dcc5-424f-81e6-aa5623908271 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b91ab94a-82ca-45c9-84b8-b2d28eae9a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:03:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:03:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Creating image(s)
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Ensure instance console log exists: /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start _get_guest_xml network_info=[{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '93078cc6-422f-4b44-a385-58d9bbbeb44c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f645085b-cb51-4134-ad75-b635ff687ed2', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'serial': 'e3a8516e-8593-40fb-a8cf-8d35b64ed56b'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:03:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:03:49 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:03:49 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:03:49 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[80edfe2e-4aca-4c8e-9429-00f2ba608a94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:03:49 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a03769-8354-4a18-be65-0426fdbb5b2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b] added
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[060a463b-c849-4fb8-8aff-24de960e8122]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc10bfa-ca2d-464b-adaa-73b182265756]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaUThtMP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaUThtMP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b33927-4cd8-4685-8eb1-7c91d2409305]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FaUThtMP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6811c4-5f43-4919-a379-91e59238e156]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cee4bb3-74bf-4b7a-a132-63c02263fcf0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b551fdf-1788-4bb7-a67f-0d78c2278ee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]
Nov 02 23:03:49 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[30188b2c-60aa-4242-9a1a-a22aa8e94b84]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701d009-e786-4d31-97b6-3bc4670a6c47]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:03:49 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:03:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeace48f-0e91-4e50-be8c-ed6dc3170bb1]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:03:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26561383138643638', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561383138643638', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2043823634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lazy-loading 'pci_devices' on Instance uuid f645085b-cb51-4134-ad75-b635ff687ed2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:03:50 user nova-compute[74721]:   <uuid>f645085b-cb51-4134-ad75-b635ff687ed2</uuid>
Nov 02 23:03:50 user nova-compute[74721]:   <name>instance-00000011</name>
Nov 02 23:03:50 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:03:50 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:03:50 user nova-compute[74721]:   <metadata>
Nov 02 23:03:50 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:03:50 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:03:50 user nova-compute[74721]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2043823634</nova:name>
Nov 02 23:03:50 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:03:49</nova:creationTime>
Nov 02 23:03:50 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:03:50 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:03:50 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:03:50 user nova-compute[74721]:       <nova:owner>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:user uuid="c2979ae9ac194589921de6ba94e576d3">tempest-ServerActionsV293TestJSON-540561610-project-member</nova:user>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:project uuid="12a31f16591d4189bd728b4d69175796">tempest-ServerActionsV293TestJSON-540561610</nova:project>
Nov 02 23:03:50 user nova-compute[74721]:       </nova:owner>
Nov 02 23:03:50 user nova-compute[74721]:       <nova:ports>
Nov 02 23:03:50 user nova-compute[74721]:         <nova:port uuid="5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f">
Nov 02 23:03:50 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:03:50 user nova-compute[74721]:         </nova:port>
Nov 02 23:03:50 user nova-compute[74721]:       </nova:ports>
Nov 02 23:03:50 user nova-compute[74721]:     </nova:instance>
Nov 02 23:03:50 user nova-compute[74721]:   </metadata>
Nov 02 23:03:50 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:03:50 user nova-compute[74721]:     <system>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="serial">f645085b-cb51-4134-ad75-b635ff687ed2</entry>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="uuid">f645085b-cb51-4134-ad75-b635ff687ed2</entry>
Nov 02 23:03:50 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:03:50 user nova-compute[74721]:     </system>
Nov 02 23:03:50 user nova-compute[74721]:   </sysinfo>
Nov 02 23:03:50 user nova-compute[74721]:   <os>
Nov 02 23:03:50 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:03:50 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:03:50 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:03:50 user nova-compute[74721]:   </os>
Nov 02 23:03:50 user nova-compute[74721]:   <features>
Nov 02 23:03:50 user nova-compute[74721]:     <acpi/>
Nov 02 23:03:50 user nova-compute[74721]:     <apic/>
Nov 02 23:03:50 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:03:50 user nova-compute[74721]:   </features>
Nov 02 23:03:50 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:03:50 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:03:50 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:03:50 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:03:50 user nova-compute[74721]:   </clock>
Nov 02 23:03:50 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:03:50 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:03:50 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:03:50 user nova-compute[74721]:   </cpu>
Nov 02 23:03:50 user nova-compute[74721]:   <devices>
Nov 02 23:03:50 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:03:50 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:03:50 user nova-compute[74721]:       <source dev="/dev/sdd"/>
Nov 02 23:03:50 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:03:50 user nova-compute[74721]:       <serial>e3a8516e-8593-40fb-a8cf-8d35b64ed56b</serial>
Nov 02 23:03:50 user nova-compute[74721]:     </disk>
Nov 02 23:03:50 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:03:50 user nova-compute[74721]:       <mac address="fa:16:3e:ac:f0:b6"/>
Nov 02 23:03:50 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:50 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:03:50 user nova-compute[74721]:       <target dev="tap5f07a5be-f2"/>
Nov 02 23:03:50 user nova-compute[74721]:     </interface>
Nov 02 23:03:50 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:03:50 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2/console.log" append="off"/>
Nov 02 23:03:50 user nova-compute[74721]:     </serial>
Nov 02 23:03:50 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:03:50 user nova-compute[74721]:     <video>
Nov 02 23:03:50 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:03:50 user nova-compute[74721]:     </video>
Nov 02 23:03:50 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:03:50 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:03:50 user nova-compute[74721]:     </rng>
Nov 02 23:03:50 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:03:50 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:03:50 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:03:50 user nova-compute[74721]:     </memballoon>
Nov 02 23:03:50 user nova-compute[74721]:   </devices>
Nov 02 23:03:50 user nova-compute[74721]: </domain>
Nov 02 23:03:50 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2043823634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG os_vif [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '781028e6-bbeb-5f98-a2f9-2d14c4048fdb', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f07a5be-f2, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f07a5be-f2, col_values=(('qos', UUID('46b2d770-37d5-4b95-b9b7-42aa15a5fbb7')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f07a5be-f2, col_values=(('external_ids', {'iface-id': '5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:f0:b6', 'vm-uuid': 'f645085b-cb51-4134-ad75-b635ff687ed2'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:50 user nova-compute[74721]: INFO os_vif [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2')
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:03:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] No VIF found with MAC fa:16:3e:ac:f0:b6, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:52 user nova-compute[74721]: WARNING nova.compute.manager [req-29a8aae2-3e3f-46f7-9850-d80ce933b196 req-47d0ff0c-afe8-4382-9da3-b617d8133297 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state building and task_state spawning.
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:03:54 user nova-compute[74721]: WARNING nova.compute.manager [req-9f825e0e-002c-4980-9f08-e6e14ee50c04 req-9259fb4c-5a12-4275-9c18-f7e4a4d120c8 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state building and task_state spawning.
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:03:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance spawned successfully.
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:03:54 user nova-compute[74721]: INFO nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 02 23:03:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:03:54 user nova-compute[74721]: INFO nova.compute.manager [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Took 28.73 seconds to build instance.
Nov 02 23:03:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bef672a-fbfe-46ac-8136-316b915ec8cf tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.842s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:03:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:03:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-changed-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Refreshing instance network info cache due to event network-changed-71b32ddb-eedb-465d-a62e-07e78cec625f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:04:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] Acquiring lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:04:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] Acquired lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:04:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Refreshing network info cache for port 71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:04:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updated VIF entry in instance network info cache for port 71b32ddb-eedb-465d-a62e-07e78cec625f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:04:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updating instance_info_cache with network_info: [{"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-819e66ef-f408-4c76-8c3d-b355621450cf req-1a8aa356-b68c-4c78-aa6b-c9b2da251864 service nova] Releasing lock "refresh_cache-de639e34-1cd6-4e18-b086-ea4f0303eeb6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:04:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:04 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:04:04 user nova-compute[74721]: INFO nova.compute.claims [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Claim successful on node user
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:04:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.policy [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9b1fd8951443c2b99bbd5097ae5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3d78232483429696ed2b344053d838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:04:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Creating image(s)
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "/opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "/opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "/opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk 1073741824" returned: 0 in 0.066s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Successfully created port: 4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Cannot resize image /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Ensure instance console log exists: /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:06 user nova-compute[74721]: INFO nova.compute.manager [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Terminating instance
Nov 02 23:04:06 user nova-compute[74721]: DEBUG nova.compute.manager [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Successfully updated port: 4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquired lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-changed-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Refreshing instance network info cache due to event network-changed-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] Acquiring lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Instance destroyed successfully.
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lazy-loading 'resources' on Instance uuid 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1399585792',display_name='tempest-VolumesAdminNegativeTest-server-1399585792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1399585792',id=5,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzzIlPQtoAZBYvHTTDuE7S7BqiGMfc+3NzfMqrNL+ltqsYQJFdQw2Wf8WuvGLFqcumy+QK1Pgf1f4LQfSK/SzgzoyMovyGhK32U2bnvwj1sGmepfGJ5Kl47w+caeJySWw==',key_name='tempest-keypair-1721132232',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:56:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b0c73c0e50491b822af310ddfbd64c',ramdisk_id='',reservation_id='r-2z7910bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77842526',owner_user_name='tempest-VolumesAdminNegativeTest-77842526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58614dc2b66e4f148f5caf8fa1e8f0d1',uuid=5e10c2d6-c1ca-4189-8833-bc40b17e19f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converting VIF {"id": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "address": "fa:16:3e:bd:e3:6f", "network": {"id": "a003e91f-0374-47f3-93c3-bea5b1f0eb45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591060270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b0c73c0e50491b822af310ddfbd64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faeef5f-f1", "ovs_interfaceid": "8faeef5f-f193-42ee-b8d9-5eb8aacbc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG os_vif [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8faeef5f-f1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updating instance_info_cache with network_info: [{"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ed022c2-02e1-425f-a8c6-345cbeeb0ee4) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: INFO os_vif [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e3:6f,bridge_name='br-int',has_traffic_filtering=True,id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d,network=Network(a003e91f-0374-47f3-93c3-bea5b1f0eb45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faeef5f-f1')
Nov 02 23:04:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Deleting instance files /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5_del
Nov 02 23:04:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Deletion of /opt/stack/data/nova/instances/5e10c2d6-c1ca-4189-8833-bc40b17e19f5_del complete
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Releasing lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Instance network_info: |[{"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] Acquired lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Refreshing network info cache for port 4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Start _get_guest_xml network_info=[{"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:04:07 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:07 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-400544873',display_name='tempest-ServersNegativeTestJSON-server-400544873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-400544873',id=18,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-6a0oqsho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:04:06Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=848014b4-7b18-46ac-aa18-d85ad52c6eef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lazy-loading 'pci_devices' on Instance uuid 848014b4-7b18-46ac-aa18-d85ad52c6eef {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:04:07 user nova-compute[74721]:   <uuid>848014b4-7b18-46ac-aa18-d85ad52c6eef</uuid>
Nov 02 23:04:07 user nova-compute[74721]:   <name>instance-00000012</name>
Nov 02 23:04:07 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:04:07 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:04:07 user nova-compute[74721]:   <metadata>
Nov 02 23:04:07 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:04:07 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:name>tempest-ServersNegativeTestJSON-server-400544873</nova:name>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:04:07</nova:creationTime>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:04:07 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:04:07 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:owner>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:user uuid="9a9b1fd8951443c2b99bbd5097ae5a6d">tempest-ServersNegativeTestJSON-1186473108-project-member</nova:user>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:project uuid="8d3d78232483429696ed2b344053d838">tempest-ServersNegativeTestJSON-1186473108</nova:project>
Nov 02 23:04:07 user nova-compute[74721]:       </nova:owner>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:04:07 user nova-compute[74721]:       <nova:ports>
Nov 02 23:04:07 user nova-compute[74721]:         <nova:port uuid="4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83">
Nov 02 23:04:07 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 23:04:07 user nova-compute[74721]:         </nova:port>
Nov 02 23:04:07 user nova-compute[74721]:       </nova:ports>
Nov 02 23:04:07 user nova-compute[74721]:     </nova:instance>
Nov 02 23:04:07 user nova-compute[74721]:   </metadata>
Nov 02 23:04:07 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:04:07 user nova-compute[74721]:     <system>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="serial">848014b4-7b18-46ac-aa18-d85ad52c6eef</entry>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="uuid">848014b4-7b18-46ac-aa18-d85ad52c6eef</entry>
Nov 02 23:04:07 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:04:07 user nova-compute[74721]:     </system>
Nov 02 23:04:07 user nova-compute[74721]:   </sysinfo>
Nov 02 23:04:07 user nova-compute[74721]:   <os>
Nov 02 23:04:07 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:04:07 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:04:07 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:04:07 user nova-compute[74721]:   </os>
Nov 02 23:04:07 user nova-compute[74721]:   <features>
Nov 02 23:04:07 user nova-compute[74721]:     <acpi/>
Nov 02 23:04:07 user nova-compute[74721]:     <apic/>
Nov 02 23:04:07 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:04:07 user nova-compute[74721]:   </features>
Nov 02 23:04:07 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:04:07 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:04:07 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:04:07 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:04:07 user nova-compute[74721]:   </clock>
Nov 02 23:04:07 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:04:07 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:04:07 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:04:07 user nova-compute[74721]:   </cpu>
Nov 02 23:04:07 user nova-compute[74721]:   <devices>
Nov 02 23:04:07 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:04:07 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:04:07 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk"/>
Nov 02 23:04:07 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:04:07 user nova-compute[74721]:     </disk>
Nov 02 23:04:07 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:04:07 user nova-compute[74721]:       <mac address="fa:16:3e:c5:1a:25"/>
Nov 02 23:04:07 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:04:07 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:04:07 user nova-compute[74721]:       <target dev="tap4b4e9a84-4a"/>
Nov 02 23:04:07 user nova-compute[74721]:     </interface>
Nov 02 23:04:07 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:04:07 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/console.log" append="off"/>
Nov 02 23:04:07 user nova-compute[74721]:     </serial>
Nov 02 23:04:07 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:04:07 user nova-compute[74721]:     <video>
Nov 02 23:04:07 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:04:07 user nova-compute[74721]:     </video>
Nov 02 23:04:07 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:04:07 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:04:07 user nova-compute[74721]:     </rng>
Nov 02 23:04:07 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:04:07 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:04:07 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:04:07 user nova-compute[74721]:     </memballoon>
Nov 02 23:04:07 user nova-compute[74721]:   </devices>
Nov 02 23:04:07 user nova-compute[74721]: </domain>
Nov 02 23:04:07 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-400544873',display_name='tempest-ServersNegativeTestJSON-server-400544873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-400544873',id=18,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-6a0oqsho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:04:06Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=848014b4-7b18-46ac-aa18-d85ad52c6eef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG os_vif [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:04:07 user nova-compute[74721]: INFO nova.compute.manager [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 23:04:07 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bab8629f-df59-5777-9fa7-603f2c360bec', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b4e9a84-4a, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b4e9a84-4a, col_values=(('qos', UUID('fbc8db18-1037-43a4-95cb-900f7280c202')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b4e9a84-4a, col_values=(('external_ids', {'iface-id': '4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:1a:25', 'vm-uuid': '848014b4-7b18-46ac-aa18-d85ad52c6eef'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:07 user nova-compute[74721]: INFO os_vif [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a')
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] No VIF found with MAC fa:16:3e:c5:1a:25, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lazy-loading 'flavor' on Instance uuid de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updated VIF entry in instance network info cache for port 4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updating instance_info_cache with network_info: [{"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d1c98ab-b195-4db2-9400-6dde7f2f3778 req-0fc59a1f-c553-43ee-868b-560cef99121c service nova] Releasing lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:08 user nova-compute[74721]: INFO nova.compute.manager [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Attaching volume 482d4283-b557-4ddf-b4f2-8942d2593188 to /dev/vdb
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.utils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41437e77-591d-450f-8f7c-93e9cdf70c40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a3433e-7289-408d-9c01-98aca18fed9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d8526-1edb-4b6b-80e9-f26ae20caa17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe5adc-01de-4a97-a4e6-7f53a6ad4ace]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:04:08 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:04:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add95ff-472a-41ad-af4e-94e5f36d7626]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG os_brick.utils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updating existing volume attachment record: f10ae875-a056-4f0f-a1d0-1d79f3a36a5a {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-e5e47797-1d17-44ec-bc03-59b429e15174 req-f1fb6828-f607-4400-97b2-c2905c55115e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Received event network-vif-deleted-8faeef5f-f193-42ee-b8d9-5eb8aacbc02d {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:08 user nova-compute[74721]: INFO nova.compute.manager [req-e5e47797-1d17-44ec-bc03-59b429e15174 req-f1fb6828-f607-4400-97b2-c2905c55115e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Neutron deleted interface 8faeef5f-f193-42ee-b8d9-5eb8aacbc02d; detaching it from the instance and deleting it from the info cache
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-e5e47797-1d17-44ec-bc03-59b429e15174 req-f1fb6828-f607-4400-97b2-c2905c55115e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:08 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Took 0.99 seconds to deallocate network for instance.
Nov 02 23:04:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-e5e47797-1d17-44ec-bc03-59b429e15174 req-f1fb6828-f607-4400-97b2-c2905c55115e service nova] [instance: 5e10c2d6-c1ca-4189-8833-bc40b17e19f5] Detach interface failed, port_id=8faeef5f-f193-42ee-b8d9-5eb8aacbc02d, reason: Instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'info_cache' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Deleted allocations for instance 5e10c2d6-c1ca-4189-8833-bc40b17e19f5
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dcaf6ab2-26d9-46ce-a2b5-caec1e8e9562 tempest-VolumesAdminNegativeTest-77842526 tempest-VolumesAdminNegativeTest-77842526-project-member] Lock "5e10c2d6-c1ca-4189-8833-bc40b17e19f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] No waiting events found dispatching network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:09 user nova-compute[74721]: WARNING nova.compute.manager [req-c79e0fa5-4204-4e80-ba71-8f31381821d1 req-34222765-6000-4d76-9258-7a9338988463 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received unexpected event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 for instance with vm_state building and task_state spawning.
Nov 02 23:04:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:04:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance destroyed successfully.
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'resources' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG os_vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b517f6-e9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=662405e0-1af3-4094-8a13-ffdb036aa7ec) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:09 user nova-compute[74721]: INFO os_vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start _get_guest_xml network_info=[{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:04:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'numa_topology' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:10 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:10 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:04:10 user nova-compute[74721]:   <uuid>80e598d8-a24f-412f-a083-3de7b0b853b3</uuid>
Nov 02 23:04:10 user nova-compute[74721]:   <name>instance-00000003</name>
Nov 02 23:04:10 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:04:10 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:04:10 user nova-compute[74721]:   <metadata>
Nov 02 23:04:10 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:04:10 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeTestJSON-server-758223653</nova:name>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:04:10</nova:creationTime>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:04:10 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:04:10 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:owner>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:user uuid="6ce9460acd644a25a9c32ade02941243">tempest-AttachVolumeTestJSON-1894655503-project-member</nova:user>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:project uuid="bca4498dfb724e13ba1086d4e687d1ef">tempest-AttachVolumeTestJSON-1894655503</nova:project>
Nov 02 23:04:10 user nova-compute[74721]:       </nova:owner>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:04:10 user nova-compute[74721]:       <nova:ports>
Nov 02 23:04:10 user nova-compute[74721]:         <nova:port uuid="d0b517f6-e930-4e60-8193-2aa28648ac45">
Nov 02 23:04:10 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:04:10 user nova-compute[74721]:         </nova:port>
Nov 02 23:04:10 user nova-compute[74721]:       </nova:ports>
Nov 02 23:04:10 user nova-compute[74721]:     </nova:instance>
Nov 02 23:04:10 user nova-compute[74721]:   </metadata>
Nov 02 23:04:10 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:04:10 user nova-compute[74721]:     <system>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="serial">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="uuid">80e598d8-a24f-412f-a083-3de7b0b853b3</entry>
Nov 02 23:04:10 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:04:10 user nova-compute[74721]:     </system>
Nov 02 23:04:10 user nova-compute[74721]:   </sysinfo>
Nov 02 23:04:10 user nova-compute[74721]:   <os>
Nov 02 23:04:10 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:04:10 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:04:10 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:04:10 user nova-compute[74721]:   </os>
Nov 02 23:04:10 user nova-compute[74721]:   <features>
Nov 02 23:04:10 user nova-compute[74721]:     <acpi/>
Nov 02 23:04:10 user nova-compute[74721]:     <apic/>
Nov 02 23:04:10 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:04:10 user nova-compute[74721]:   </features>
Nov 02 23:04:10 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:04:10 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:04:10 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:04:10 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:04:10 user nova-compute[74721]:   </clock>
Nov 02 23:04:10 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:04:10 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:04:10 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:04:10 user nova-compute[74721]:   </cpu>
Nov 02 23:04:10 user nova-compute[74721]:   <devices>
Nov 02 23:04:10 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:04:10 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:04:10 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk"/>
Nov 02 23:04:10 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:04:10 user nova-compute[74721]:     </disk>
Nov 02 23:04:10 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:04:10 user nova-compute[74721]:       <mac address="fa:16:3e:ce:ca:8f"/>
Nov 02 23:04:10 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:04:10 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:04:10 user nova-compute[74721]:       <target dev="tapd0b517f6-e9"/>
Nov 02 23:04:10 user nova-compute[74721]:     </interface>
Nov 02 23:04:10 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:04:10 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/console.log" append="off"/>
Nov 02 23:04:10 user nova-compute[74721]:     </serial>
Nov 02 23:04:10 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:04:10 user nova-compute[74721]:     <video>
Nov 02 23:04:10 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:04:10 user nova-compute[74721]:     </video>
Nov 02 23:04:10 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:04:10 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:04:10 user nova-compute[74721]:     </rng>
Nov 02 23:04:10 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:04:10 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:04:10 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:04:10 user nova-compute[74721]:     </memballoon>
Nov 02 23:04:10 user nova-compute[74721]:   </devices>
Nov 02 23:04:10 user nova-compute[74721]: </domain>
Nov 02 23:04:10 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Cannot resize image /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'migration_context' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.objects.base [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Object Instance<80e598d8-a24f-412f-a083-3de7b0b853b3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG os_vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f618c7e9-f9a9-5b1d-90ca-bd8341b2a0c4', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b517f6-e9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b517f6-e9, col_values=(('qos', UUID('ed546662-6275-4d2a-9d46-217278cdfbc8')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b517f6-e9, col_values=(('external_ids', {'iface-id': 'd0b517f6-e930-4e60-8193-2aa28648ac45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ca:8f', 'vm-uuid': '80e598d8-a24f-412f-a083-3de7b0b853b3'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:11 user nova-compute[74721]: INFO os_vif [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:04:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Instance spawned successfully.
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] No waiting events found dispatching network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:11 user nova-compute[74721]: WARNING nova.compute.manager [req-81ab4d49-7980-41ef-9e8d-62ab57bab7fb req-a9457892-57cd-43ca-baf5-3e0ce7811bbf service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received unexpected event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 for instance with vm_state building and task_state spawning.
Nov 02 23:04:11 user nova-compute[74721]: INFO nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 02 23:04:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:04:12 user nova-compute[74721]: INFO nova.compute.manager [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Took 7.15 seconds to build instance.
Nov 02 23:04:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-95d96655-2f4a-4622-95f5-8fac6867aaf7 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.280s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:12 user nova-compute[74721]: WARNING nova.compute.manager [req-872a67c5-b934-4329-ba66-1814205d6cc2 req-61e4ce75-b4ae-4b9c-ae95-8be6b2963413 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state powering-on.
Nov 02 23:04:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:04:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance rebooted successfully.
Nov 02 23:04:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d63af857-8ed2-4590-99bf-4c12c891f1b0 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:14 user nova-compute[74721]: WARNING nova.compute.manager [req-7f7ec78c-5743-4ab0-9d91-c5e91debfaaa req-3c1f1d16-54a7-4edb-b4a9-0aeab5d6866a service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state stopped and task_state powering-on.
Nov 02 23:04:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:19 user nova-compute[74721]: INFO nova.compute.manager [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Terminating instance
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-unplugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] No waiting events found dispatching network-vif-unplugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-f32aeb52-761c-46ec-b414-48437e1b19e0 req-2599a4e3-b747-49aa-a516-76f6d80cfd6b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-unplugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:04:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Instance destroyed successfully.
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lazy-loading 'resources' on Instance uuid a3acac92-dcc5-424f-81e6-aa5623908271 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1257689052',display_name='tempest-VolumesActionsTest-instance-1257689052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1257689052',id=14,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce6a9965b404965829f6aac42532bbb',ramdisk_id='',reservation_id='r-zml3w76z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-899971655',owner_user_name='tempest-VolumesActionsTest-899971655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:01:08Z,user_data=None,user_id='5150cf77c193400198252b77bd20bd76',uuid=a3acac92-dcc5-424f-81e6-aa5623908271,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converting VIF {"id": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "address": "fa:16:3e:cb:83:9a", "network": {"id": "fda65033-4112-4737-8665-1629dcfe7042", "bridge": "br-int", "label": "tempest-VolumesActionsTest-717599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce6a9965b404965829f6aac42532bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2eb2c39-07", "ovs_interfaceid": "d2eb2c39-078b-497d-9b8d-3230e31b9fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:04:19 user nova-compute[74721]: DEBUG os_vif [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2eb2c39-07, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19ef340e-c10d-4a95-9b3a-c25cdbd83fe4) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: INFO os_vif [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:83:9a,bridge_name='br-int',has_traffic_filtering=True,id=d2eb2c39-078b-497d-9b8d-3230e31b9fb2,network=Network(fda65033-4112-4737-8665-1629dcfe7042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2eb2c39-07')
Nov 02 23:04:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Deleting instance files /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271_del
Nov 02 23:04:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Deletion of /opt/stack/data/nova/instances/a3acac92-dcc5-424f-81e6-aa5623908271_del complete
Nov 02 23:04:20 user nova-compute[74721]: INFO nova.compute.manager [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 02 23:04:20 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:20 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Took 0.66 seconds to deallocate network for instance.
Nov 02 23:04:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-6c508257-1460-440c-8fc6-2c91c57a2792 req-38c517f0-5f8d-41c7-8985-c3f12a0262c4 service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-deleted-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:21 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Deleted allocations for instance a3acac92-dcc5-424f-81e6-aa5623908271
Nov 02 23:04:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6f6f0001-9d72-44fd-aca0-e1ec68d6be51 tempest-VolumesActionsTest-899971655 tempest-VolumesActionsTest-899971655-project-member] Lock "a3acac92-dcc5-424f-81e6-aa5623908271" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] Acquiring lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] Lock "a3acac92-dcc5-424f-81e6-aa5623908271-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] No waiting events found dispatching network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:04:21 user nova-compute[74721]: WARNING nova.compute.manager [req-7369c025-5f38-40b9-ad65-3ffd9ee4abf2 req-9b1c97be-c344-4645-b256-517f4d5acf3b service nova] [instance: a3acac92-dcc5-424f-81e6-aa5623908271] Received unexpected event network-vif-plugged-d2eb2c39-078b-497d-9b8d-3230e31b9fb2 for instance with vm_state deleted and task_state None.
Nov 02 23:04:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:04:27 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:04:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [{"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:04:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-80e598d8-a24f-412f-a083-3de7b0b853b3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:04:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:04:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:04:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:35 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:04:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:04:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.50222396850586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b91ab94a-82ca-45c9-84b8-b2d28eae9a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:04:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:04:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:04:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:04:43 user nova-compute[74721]: INFO nova.compute.manager [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Detaching volume 2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:04:43 user nova-compute[74721]: INFO nova.virt.block_device [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Attempting to driver detach volume 2d05853f-583d-4eab-b2cf-db8333787930 from mountpoint /dev/vdb
Nov 02 23:04:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Attempting to detach device vdb from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:04:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:04:43 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:04:43 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:04:43 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:04:43 user nova-compute[74721]:   <serial>2d05853f-583d-4eab-b2cf-db8333787930</serial>
Nov 02 23:04:43 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:04:43 user nova-compute[74721]: </disk>
Nov 02 23:04:43 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:04:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully detached device vdb from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the persistent domain config.
Nov 02 23:04:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:04:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:04:43 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:04:43 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:04:43 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:04:43 user nova-compute[74721]:   <serial>2d05853f-583d-4eab-b2cf-db8333787930</serial>
Nov 02 23:04:43 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:04:43 user nova-compute[74721]: </disk>
Nov 02 23:04:43 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:04:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:04:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:04:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:03 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 is timed out.
Nov 02 23:05:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully detached device vdb from instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 from the live domain config.
Nov 02 23:05:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuaspfZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:03 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae248cb7-c252-42b2-a4eb-c8c6871efc21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:05:03 user nova-compute[74721]: No targets found.
Nov 02 23:05:03 user nova-compute[74721]: iSNS:
Nov 02 23:05:03 user nova-compute[74721]: No targets found.
Nov 02 23:05:03 user nova-compute[74721]: STATIC:
Nov 02 23:05:03 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930
Nov 02 23:05:03 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:03 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:03 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b
Nov 02 23:05:03 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:03 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:03 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:05:03 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:03 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:03 user nova-compute[74721]: FIRMWARE:
Nov 02 23:05:03 user nova-compute[74721]: No targets found.
Nov 02 23:05:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:05:03 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:05:03 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183cde1-addf-4242-9c67-4aa1ba462ea3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5668916-e9a1-4070-a7d6-795e64626270]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:05:03 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:03 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 (non-flash)
Nov 02 23:05:03 user nova-compute[74721]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:03 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243772e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[561cd366-13f8-46b9-abf8-f9d90f47ef46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238b5be-83ed-476a-b5a0-e40d263848f8]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef899a-8508-440e-856f-1bb86ce7e66c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:05:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16edd09-5a1e-4736-9000-763246378e6d]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82eb898-370b-4fb8-b5be-61151ad738cc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4768b4-a834-41e7-abcc-1cd3e2d070ff]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260]
Nov 02 23:05:04 user nova-compute[74721]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930, portal: 172.16.0.220,3260] successful.
Nov 02 23:05:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d05853f-583d-4eab-b2cf-db8333787930 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb10a4-5614-40f4-9784-8448ceab6c70]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== disconnect_volume: return (368ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:05:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:05 user nova-compute[74721]: DEBUG nova.objects.instance [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'flavor' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9981a2f0-f8d2-4a0d-bcc8-631ea9781215 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lazy-loading 'flavor' on Instance uuid b91ab94a-82ca-45c9-84b8-b2d28eae9a72 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSMgmWVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:12 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:12 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:12 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:12 user nova-compute[74721]: INFO nova.compute.manager [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Attaching volume 39da4a76-88cb-4633-a0cb-012dedf6e6df to /dev/vdb
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46d215-c126-4b41-9a35-fb689fe5dbe0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:05:12 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c82b3ec-5772-4b8a-9107-d755a8a0a189]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188] added
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced4156-f8c9-4cee-8465-6cd9214c5ac0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18fa86-7be1-4441-b503-7741ba9c8bc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade53672-0c34-4057-b395-7b16bfbd345c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSMgmWVc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbba66ae-d7d7-4ff1-b376-7a8dec8770ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSMgmWVc" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530d9ae-e5f2-43df-968e-38ebecef7bb1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vSMgmWVc'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254cde5-928b-4f6a-abf4-3f831f931858]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b83c5e-736c-4ec5-8ec6-abdfcd575758]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b955484-090e-43c7-b59a-ccbc4a7f48d0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:05:12 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d56011-a61e-4f7d-b41e-8fc4a411db81]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updating existing volume attachment record: b3756815-42c5-4893-a0db-db4732de1560 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e39c54f-e92f-42be-a713-4d51ada2facd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6c8a2-18d0-45f2-8717-d184b0791693]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260]
Nov 02 23:05:12 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260] successful.
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cff809-171f-4262-a0f9-f54bef309b58]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd25c2a-e464-4a02-bcd0-05b94dbd5a6b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:12 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:12 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[918272e9-ae94-4e67-9fe7-b18c31993025]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:12 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSMgmWVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23733666335323538', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733666335323538', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lazy-loading 'flavor' on Instance uuid de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:05:13 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:05:13 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:05:13 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:05:13 user nova-compute[74721]:   <serial>482d4283-b557-4ddf-b4f2-8942d2593188</serial>
Nov 02 23:05:13 user nova-compute[74721]: </disk>
Nov 02 23:05:13 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:05:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:05:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:05:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] No VIF found with MAC fa:16:3e:eb:fe:c1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:05:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1a71c08-b4e6-47f9-bfbe-30f12b95c873 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.812s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:16 user nova-compute[74721]: INFO nova.compute.manager [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Detaching volume 482d4283-b557-4ddf-b4f2-8942d2593188
Nov 02 23:05:16 user nova-compute[74721]: INFO nova.virt.block_device [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Attempting to driver detach volume 482d4283-b557-4ddf-b4f2-8942d2593188 from mountpoint /dev/vdb
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Attempting to detach device vdb from instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:05:16 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:05:16 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:05:16 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:05:16 user nova-compute[74721]:   <serial>482d4283-b557-4ddf-b4f2-8942d2593188</serial>
Nov 02 23:05:16 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:05:16 user nova-compute[74721]: </disk>
Nov 02 23:05:16 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:05:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Successfully detached device vdb from instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 from the persistent domain config.
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:05:16 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:05:16 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:05:16 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:05:16 user nova-compute[74721]:   <serial>482d4283-b557-4ddf-b4f2-8942d2593188</serial>
Nov 02 23:05:16 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:05:16 user nova-compute[74721]: </disk>
Nov 02 23:05:16 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:05:17 user nova-compute[74721]: INFO nova.compute.claims [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Claim successful on node user
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-changed-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Refreshing instance network info cache due to event network-changed-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] Acquiring lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] Acquired lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Refreshing network info cache for port 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:05:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.policy [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83010d67d3514cd69c99767c0b77fb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd99aa517e74a5aa15c46d174a025b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:05:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Creating image(s)
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "/opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.220s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updated VIF entry in instance network info cache for port 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating instance_info_cache with network_info: [{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk 1073741824" returned: 0 in 0.078s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Successfully created port: ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7d2d8d8-15eb-4815-9f7b-176db947c987 req-ae71f07a-6492-4f11-b00b-d4f5376bd1b6 service nova] Releasing lock "refresh_cache-f645085b-cb51-4134-ad75-b635ff687ed2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:05:18 user nova-compute[74721]: INFO nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Rebuilding instance
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Cannot resize image /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Ensure instance console log exists: /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:19 user nova-compute[74721]: WARNING nova.compute.manager [req-7f0f72e8-5b6d-4c0e-b5b3-45653d590bb2 req-e1066463-d4fb-47c3-a7fd-0c16551f5c64 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state active and task_state rebuilding.
Nov 02 23:05:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance destroyed successfully.
Nov 02 23:05:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance destroyed successfully.
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-342025052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f07a5be-f2, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46b2d770-37d5-4b95-b9b7-42aa15a5fbb7) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:19 user nova-compute[74721]: INFO os_vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2')
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:19 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Successfully updated port: ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b489c7b-d4ee-4946-a3a2-f09bac316e87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:05:19 user nova-compute[74721]: No targets found.
Nov 02 23:05:19 user nova-compute[74721]: iSNS:
Nov 02 23:05:19 user nova-compute[74721]: No targets found.
Nov 02 23:05:19 user nova-compute[74721]: STATIC:
Nov 02 23:05:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188
Nov 02 23:05:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b
Nov 02 23:05:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:05:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:19 user nova-compute[74721]: FIRMWARE:
Nov 02 23:05:19 user nova-compute[74721]: No targets found.
Nov 02 23:05:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:05:19 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:05:19 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquired lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718c6da-bcdb-4cce-b625-e62f0fe9450e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03dd74b-dbfa-4742-91a4-1146924946c0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:19 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:19 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:19 user nova-compute[74721]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:05:19 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf247103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d3ea6d-3c6b-4c11-95e7-d70445074d74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcce62e-7a66-4a6c-8035-f69ec938b26d]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece6820-24d2-4ad4-85cc-0a203be7df0e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c957198-161a-4f46-8b12-1534232cee7e]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d89f3a03',) {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[db026cf6-9e6d-4ce0-b672-302f9a7655e1]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be805ab-fb26-49fa-8092-93ff8f7b1079]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[046b15b6-5ed6-4c2f-8d87-cb083779dc0c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]
Nov 02 23:05:20 user nova-compute[74721]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.
Nov 02 23:05:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9328ca-7a0b-43d5-aaf9-e0b62fd0715e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== disconnect_volume: return (371ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:05:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deleting instance files /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2_del
Nov 02 23:05:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deletion of /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2_del complete
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating instance_info_cache with network_info: [{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Releasing lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Instance network_info: |[{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Start _get_guest_xml network_info=[{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:05:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-247955098',display_name='tempest-AttachVolumeNegativeTest-server-247955098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-247955098',id=19,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu5nKjH+hw6XpGhVbIPppb5lCK1jSG1+PX4qFBjn96ef1hTOrZssEoFAyto3xVVG0n9pSOHZrehohs4X2BbTBnwtDChjQ9pQnj3sCgWMbfe4OSQcjSpfBuMzBap3kgLzw==',key_name='tempest-keypair-1359130630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-haykdqsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'pci_devices' on Instance uuid adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:05:20 user nova-compute[74721]:   <uuid>adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d</uuid>
Nov 02 23:05:20 user nova-compute[74721]:   <name>instance-00000013</name>
Nov 02 23:05:20 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:05:20 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:05:20 user nova-compute[74721]:   <metadata>
Nov 02 23:05:20 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:05:20 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeNegativeTest-server-247955098</nova:name>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:05:20</nova:creationTime>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:05:20 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:05:20 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:owner>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:user uuid="83010d67d3514cd69c99767c0b77fb67">tempest-AttachVolumeNegativeTest-1503140472-project-member</nova:user>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:project uuid="0bd99aa517e74a5aa15c46d174a025b0">tempest-AttachVolumeNegativeTest-1503140472</nova:project>
Nov 02 23:05:20 user nova-compute[74721]:       </nova:owner>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:05:20 user nova-compute[74721]:       <nova:ports>
Nov 02 23:05:20 user nova-compute[74721]:         <nova:port uuid="ba4c963e-8ead-4200-8ff3-805e08aa0460">
Nov 02 23:05:20 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 23:05:20 user nova-compute[74721]:         </nova:port>
Nov 02 23:05:20 user nova-compute[74721]:       </nova:ports>
Nov 02 23:05:20 user nova-compute[74721]:     </nova:instance>
Nov 02 23:05:20 user nova-compute[74721]:   </metadata>
Nov 02 23:05:20 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:05:20 user nova-compute[74721]:     <system>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="serial">adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d</entry>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="uuid">adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d</entry>
Nov 02 23:05:20 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:05:20 user nova-compute[74721]:     </system>
Nov 02 23:05:20 user nova-compute[74721]:   </sysinfo>
Nov 02 23:05:20 user nova-compute[74721]:   <os>
Nov 02 23:05:20 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:05:20 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:05:20 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:05:20 user nova-compute[74721]:   </os>
Nov 02 23:05:20 user nova-compute[74721]:   <features>
Nov 02 23:05:20 user nova-compute[74721]:     <acpi/>
Nov 02 23:05:20 user nova-compute[74721]:     <apic/>
Nov 02 23:05:20 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:05:20 user nova-compute[74721]:   </features>
Nov 02 23:05:20 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:05:20 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:05:20 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:05:20 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:05:20 user nova-compute[74721]:   </clock>
Nov 02 23:05:20 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:05:20 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:05:20 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:05:20 user nova-compute[74721]:   </cpu>
Nov 02 23:05:20 user nova-compute[74721]:   <devices>
Nov 02 23:05:20 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:05:20 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:05:20 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk"/>
Nov 02 23:05:20 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:05:20 user nova-compute[74721]:     </disk>
Nov 02 23:05:20 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:05:20 user nova-compute[74721]:       <mac address="fa:16:3e:e0:d6:46"/>
Nov 02 23:05:20 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:05:20 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:05:20 user nova-compute[74721]:       <target dev="tapba4c963e-8e"/>
Nov 02 23:05:20 user nova-compute[74721]:     </interface>
Nov 02 23:05:20 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:05:20 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/console.log" append="off"/>
Nov 02 23:05:20 user nova-compute[74721]:     </serial>
Nov 02 23:05:20 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:05:20 user nova-compute[74721]:     <video>
Nov 02 23:05:20 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:05:20 user nova-compute[74721]:     </video>
Nov 02 23:05:20 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:05:20 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:05:20 user nova-compute[74721]:     </rng>
Nov 02 23:05:20 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:05:20 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:05:20 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:05:20 user nova-compute[74721]:     </memballoon>
Nov 02 23:05:20 user nova-compute[74721]:   </devices>
Nov 02 23:05:20 user nova-compute[74721]: </domain>
Nov 02 23:05:20 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-247955098',display_name='tempest-AttachVolumeNegativeTest-server-247955098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-247955098',id=19,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu5nKjH+hw6XpGhVbIPppb5lCK1jSG1+PX4qFBjn96ef1hTOrZssEoFAyto3xVVG0n9pSOHZrehohs4X2BbTBnwtDChjQ9pQnj3sCgWMbfe4OSQcjSpfBuMzBap3kgLzw==',key_name='tempest-keypair-1359130630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-haykdqsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_vif [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86c3942c-0000-5aec-9072-e545d35a1d23', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4c963e-8e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4c963e-8e, col_values=(('qos', UUID('2703d363-adb7-47db-b664-d5a070f89ea0')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4c963e-8e, col_values=(('external_ids', {'iface-id': 'ba4c963e-8ead-4200-8ff3-805e08aa0460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:d6:46', 'vm-uuid': 'adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:20 user nova-compute[74721]: INFO os_vif [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e')
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:e0:d6:46, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:05:20 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f645085b-cb51-4134-ad75-b635ff687ed2 could not be found.
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:20 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[516560ba-2660-4364-b83f-b9d77acd6b28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:05:20 user nova-compute[74721]: No targets found.
Nov 02 23:05:20 user nova-compute[74721]: iSNS:
Nov 02 23:05:20 user nova-compute[74721]: No targets found.
Nov 02 23:05:20 user nova-compute[74721]: STATIC:
Nov 02 23:05:20 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188
Nov 02 23:05:20 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:20 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:20 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:05:20 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:20 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:20 user nova-compute[74721]: FIRMWARE:
Nov 02 23:05:20 user nova-compute[74721]: No targets found.
Nov 02 23:05:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:05:20 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:05:20 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7edcc3e-b4c8-4b5e-a446-40a149db04e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c6a206-4664-4763-8b6f-a1236fe50f5e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:20 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:20 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243b0280>, {}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Disconnecting from: [] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== disconnect_volume: return (81ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:05:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:21 user nova-compute[74721]: WARNING nova.compute.manager [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state active and task_state rebuilding.
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-changed-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Refreshing instance network info cache due to event network-changed-ba4c963e-8ead-4200-8ff3-805e08aa0460. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Acquiring lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Acquired lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Refreshing network info cache for port ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Preparing to wait for external event volume-reimaged-e3a8516e-8593-40fb-a8cf-8d35b64ed56b {{(pid=74721) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updated VIF entry in instance network info cache for port ba4c963e-8ead-4200-8ff3-805e08aa0460. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:05:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating instance_info_cache with network_info: [{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-95154886-dd0a-46d4-b4a8-3394abf9fdc4 req-f42f24ec-8a89-42ec-82f1-d989dddbfefb service nova] Releasing lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:05:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] No waiting events found dispatching network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:23 user nova-compute[74721]: WARNING nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received unexpected event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 for instance with vm_state building and task_state spawning.
Nov 02 23:05:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] No waiting events found dispatching network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:23 user nova-compute[74721]: WARNING nova.compute.manager [req-42a59c79-56b6-4b2b-b822-95d8a1b122ed req-4139fbf8-10a7-47ee-8bb2-7ef7c261b612 service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received unexpected event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 for instance with vm_state building and task_state spawning.
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:05:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Instance spawned successfully.
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:05:24 user nova-compute[74721]: INFO nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 02 23:05:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:05:24 user nova-compute[74721]: INFO nova.compute.manager [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Took 7.26 seconds to build instance.
Nov 02 23:05:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3ab01fb9-1258-4016-96a9-97867d5756fe tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.424s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:05:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:05:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:05:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:33 user nova-compute[74721]: INFO nova.compute.manager [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Terminating instance
Nov 02 23:05:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-2e3788cb-5056-4bed-8c9a-57f8dfadfef4 req-4e662ce8-5423-425e-96b7-e99306cbfe5d service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-unplugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Instance destroyed successfully.
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'resources' on Instance uuid 28634ace-efa2-45a1-bbd9-9bb3f29bef01 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-319264424',display_name='tempest-ServerActionsTestOtherA-server-1950633378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-319264424',id=12,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN1JJVq0yGl6mEMHbbVXbEGyef77RbWDuBfl7reAVH+5X+8Nlm0yYf6/LRaFtQYuuNI9VCwZg6ckWsgHWioreBP4/NKkG1IhWvjS6Qq5vGbtLlh4QWaa6I3yNPjXydjqw==',key_name='tempest-keypair-1578768211',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:02:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-uqxnm6dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=28634ace-efa2-45a1-bbd9-9bb3f29bef01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "address": "fa:16:3e:3b:45:fe", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c3d26-0a", "ovs_interfaceid": "8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG os_vif [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a7c3d26-0a, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d60f383-7ab5-449d-ae25-f96ef71e048f) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:34 user nova-compute[74721]: INFO os_vif [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:45:fe,bridge_name='br-int',has_traffic_filtering=True,id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c3d26-0a')
Nov 02 23:05:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Deleting instance files /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01_del
Nov 02 23:05:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Deletion of /opt/stack/data/nova/instances/28634ace-efa2-45a1-bbd9-9bb3f29bef01_del complete
Nov 02 23:05:34 user nova-compute[74721]: INFO nova.compute.manager [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 23:05:34 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:05:34 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:35 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:36 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Took 1.45 seconds to deallocate network for instance.
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-4f2d24cf-e6dd-491e-912a-c5e4c34869ca req-02f57630-576b-4095-a62a-bd35ab1fd725 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-deleted-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:36 user nova-compute[74721]: INFO nova.compute.manager [req-4f2d24cf-e6dd-491e-912a-c5e4c34869ca req-02f57630-576b-4095-a62a-bd35ab1fd725 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Neutron deleted interface 8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc; detaching it from the instance and deleting it from the info cache
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-4f2d24cf-e6dd-491e-912a-c5e4c34869ca req-02f57630-576b-4095-a62a-bd35ab1fd725 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-4f2d24cf-e6dd-491e-912a-c5e4c34869ca req-02f57630-576b-4095-a62a-bd35ab1fd725 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Detach interface failed, port_id=8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc, reason: Instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] Acquiring lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] No waiting events found dispatching network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:05:36 user nova-compute[74721]: WARNING nova.compute.manager [req-bd2e8e4c-c414-4e79-85b6-5b2374fbd04f req-3b29c6e3-630d-47ab-aa64-1739efe9e0c1 service nova] [instance: 28634ace-efa2-45a1-bbd9-9bb3f29bef01] Received unexpected event network-vif-plugged-8a7c3d26-0a0d-4517-84b7-c17ea3ca62fc for instance with vm_state deleted and task_state None.
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:36 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Deleted allocations for instance 28634ace-efa2-45a1-bbd9-9bb3f29bef01
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 is timed out.
Nov 02 23:05:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Successfully detached device vdb from instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 from the live domain config.
Nov 02 23:05:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSMgmWVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:05:36 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd9e5c-1c23-4c50-bd3b-b427c6c4103f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:05:36 user nova-compute[74721]: No targets found.
Nov 02 23:05:36 user nova-compute[74721]: iSNS:
Nov 02 23:05:36 user nova-compute[74721]: No targets found.
Nov 02 23:05:36 user nova-compute[74721]: STATIC:
Nov 02 23:05:36 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188
Nov 02 23:05:36 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:36 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:36 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:05:36 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:05:36 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:05:36 user nova-compute[74721]: FIRMWARE:
Nov 02 23:05:36 user nova-compute[74721]: No targets found.
Nov 02 23:05:36 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:05:36 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:05:36 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63971c2f-aa2d-4ca0-9837-160b4e56e42d tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "28634ace-efa2-45a1-bbd9-9bb3f29bef01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ff37c-8652-42f3-b4cb-99dc51205399]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a119560-0464-4e50-8c13-1d451ceb44ce]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:37 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:05:37 user nova-compute[74721]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 (non-flash)
Nov 02 23:05:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c257eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b6baa9-ea4d-4dfb-8dcc-101f319fd543]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b66eb0-4358-45ef-9758-f14d80b62869]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b3758-4a9e-497c-9807-7c7d72a78601]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e49babf-2d8e-4a08-8979-61ea70df303c]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d88f59-eeb2-4be0-bbd3-de43267855d2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c769a4d9-7d92-4ca6-9e40-c8cede5b29ff]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260]
Nov 02 23:05:37 user nova-compute[74721]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188, portal: 172.16.0.220,3260] successful.
Nov 02 23:05:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:482d4283-b557-4ddf-b4f2-8942d2593188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece8aeb-d5b7-4f37-b090-242c50f0229d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] <== disconnect_volume: return (466ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lazy-loading 'flavor' on Instance uuid de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0b82eca4-2bc0-40aa-849a-7ec17a51ca29 tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.263s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:05:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.515029907226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 80e598d8-a24f-412f-a083-3de7b0b853b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance bb70b80b-ebf8-4962-afa2-49de93c5b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance de639e34-1cd6-4e18-b086-ea4f0303eeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b91ab94a-82ca-45c9-84b8-b2d28eae9a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:05:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:05:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:05:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:05:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:05:56 user nova-compute[74721]: INFO nova.compute.claims [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Claim successful on node user
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:05:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.policy [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9b1fd8951443c2b99bbd5097ae5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3d78232483429696ed2b344053d838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:05:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Creating image(s)
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "/opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "/opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "/opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.218s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk 1073741824" returned: 0 in 0.056s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Successfully created port: 10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Cannot resize image /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Ensure instance console log exists: /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:05:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Successfully updated port: 10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquired lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received event network-changed-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Refreshing instance network info cache due to event network-changed-10901e7f-5971-4eb9-8a6d-509019ba3c79. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] Acquiring lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Updating instance_info_cache with network_info: [{"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Releasing lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Instance network_info: |[{"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] Acquired lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Refreshing network info cache for port 10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Start _get_guest_xml network_info=[{"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:05:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-114835058',display_name='tempest-ServersNegativeTestJSON-server-114835058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-114835058',id=20,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-r4u0rn5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:05:57Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=71d0fd0d-73ca-4921-9064-c9d70f98cc8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lazy-loading 'pci_devices' on Instance uuid 71d0fd0d-73ca-4921-9064-c9d70f98cc8f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:05:58 user nova-compute[74721]:   <uuid>71d0fd0d-73ca-4921-9064-c9d70f98cc8f</uuid>
Nov 02 23:05:58 user nova-compute[74721]:   <name>instance-00000014</name>
Nov 02 23:05:58 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:05:58 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:05:58 user nova-compute[74721]:   <metadata>
Nov 02 23:05:58 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:05:58 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:name>tempest-ServersNegativeTestJSON-server-114835058</nova:name>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:05:58</nova:creationTime>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:05:58 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:05:58 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:owner>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:user uuid="9a9b1fd8951443c2b99bbd5097ae5a6d">tempest-ServersNegativeTestJSON-1186473108-project-member</nova:user>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:project uuid="8d3d78232483429696ed2b344053d838">tempest-ServersNegativeTestJSON-1186473108</nova:project>
Nov 02 23:05:58 user nova-compute[74721]:       </nova:owner>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:05:58 user nova-compute[74721]:       <nova:ports>
Nov 02 23:05:58 user nova-compute[74721]:         <nova:port uuid="10901e7f-5971-4eb9-8a6d-509019ba3c79">
Nov 02 23:05:58 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:05:58 user nova-compute[74721]:         </nova:port>
Nov 02 23:05:58 user nova-compute[74721]:       </nova:ports>
Nov 02 23:05:58 user nova-compute[74721]:     </nova:instance>
Nov 02 23:05:58 user nova-compute[74721]:   </metadata>
Nov 02 23:05:58 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:05:58 user nova-compute[74721]:     <system>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="serial">71d0fd0d-73ca-4921-9064-c9d70f98cc8f</entry>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="uuid">71d0fd0d-73ca-4921-9064-c9d70f98cc8f</entry>
Nov 02 23:05:58 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:05:58 user nova-compute[74721]:     </system>
Nov 02 23:05:58 user nova-compute[74721]:   </sysinfo>
Nov 02 23:05:58 user nova-compute[74721]:   <os>
Nov 02 23:05:58 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:05:58 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:05:58 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:05:58 user nova-compute[74721]:   </os>
Nov 02 23:05:58 user nova-compute[74721]:   <features>
Nov 02 23:05:58 user nova-compute[74721]:     <acpi/>
Nov 02 23:05:58 user nova-compute[74721]:     <apic/>
Nov 02 23:05:58 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:05:58 user nova-compute[74721]:   </features>
Nov 02 23:05:58 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:05:58 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:05:58 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:05:58 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:05:58 user nova-compute[74721]:   </clock>
Nov 02 23:05:58 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:05:58 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:05:58 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:05:58 user nova-compute[74721]:   </cpu>
Nov 02 23:05:58 user nova-compute[74721]:   <devices>
Nov 02 23:05:58 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:05:58 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:05:58 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk"/>
Nov 02 23:05:58 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:05:58 user nova-compute[74721]:     </disk>
Nov 02 23:05:58 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:05:58 user nova-compute[74721]:       <mac address="fa:16:3e:6f:c6:66"/>
Nov 02 23:05:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:05:58 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:05:58 user nova-compute[74721]:       <target dev="tap10901e7f-59"/>
Nov 02 23:05:58 user nova-compute[74721]:     </interface>
Nov 02 23:05:58 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:05:58 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/console.log" append="off"/>
Nov 02 23:05:58 user nova-compute[74721]:     </serial>
Nov 02 23:05:58 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:05:58 user nova-compute[74721]:     <video>
Nov 02 23:05:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:05:58 user nova-compute[74721]:     </video>
Nov 02 23:05:58 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:05:58 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:05:58 user nova-compute[74721]:     </rng>
Nov 02 23:05:58 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:05:58 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:05:58 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:05:58 user nova-compute[74721]:     </memballoon>
Nov 02 23:05:58 user nova-compute[74721]:   </devices>
Nov 02 23:05:58 user nova-compute[74721]: </domain>
Nov 02 23:05:58 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-114835058',display_name='tempest-ServersNegativeTestJSON-server-114835058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-114835058',id=20,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-r4u0rn5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:05:57Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=71d0fd0d-73ca-4921-9064-c9d70f98cc8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG os_vif [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cf249de-412c-5ad5-97a2-e32812766f93', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10901e7f-59, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10901e7f-59, col_values=(('qos', UUID('33018d93-1610-424d-ace9-787b8d146dd8')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10901e7f-59, col_values=(('external_ids', {'iface-id': '10901e7f-5971-4eb9-8a6d-509019ba3c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:c6:66', 'vm-uuid': '71d0fd0d-73ca-4921-9064-c9d70f98cc8f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:05:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:05:58 user nova-compute[74721]: INFO os_vif [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59')
Nov 02 23:05:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:05:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] No VIF found with MAC fa:16:3e:6f:c6:66, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:05:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Updated VIF entry in instance network info cache for port 10901e7f-5971-4eb9-8a6d-509019ba3c79. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:05:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Updating instance_info_cache with network_info: [{"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:05:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b80cb21-5612-4539-aa86-dd9ccd8d5950 req-ca872964-4a6c-436a-b3be-ba5f98715151 service nova] Releasing lock "refresh_cache-71d0fd0d-73ca-4921-9064-c9d70f98cc8f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received event network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] Acquiring lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] No waiting events found dispatching network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:00 user nova-compute[74721]: WARNING nova.compute.manager [req-104abe3a-28bc-468e-9728-b65499e05772 req-bdbca102-ba6d-47f6-b09a-4386943dc65f service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received unexpected event network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 for instance with vm_state building and task_state spawning.
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:00 user nova-compute[74721]: INFO nova.compute.manager [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Terminating instance
Nov 02 23:06:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Instance destroyed successfully.
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.objects.instance [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'resources' on Instance uuid 80e598d8-a24f-412f-a083-3de7b0b853b3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758223653',display_name='tempest-AttachVolumeTestJSON-server-758223653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758223653',id=3,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU8wj7jFHnzAq33pTMxTy3GPoOrcYDDEB55CfqNNN2+AHAhb4iG/JTovhCH08lw5d8PG1dJxQrgVZg3AUza06E6GuKxc3x+tNoqpuGnDNmSrR6CKOfVm9FsW4mPKslaqA==',key_name='tempest-keypair-1053073121',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-6kgteojf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=80e598d8-a24f-412f-a083-3de7b0b853b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "d0b517f6-e930-4e60-8193-2aa28648ac45", "address": "fa:16:3e:ce:ca:8f", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b517f6-e9", "ovs_interfaceid": "d0b517f6-e930-4e60-8193-2aa28648ac45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG os_vif [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b517f6-e9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed546662-6275-4d2a-9d46-217278cdfbc8) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:01 user nova-compute[74721]: INFO os_vif [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:8f,bridge_name='br-int',has_traffic_filtering=True,id=d0b517f6-e930-4e60-8193-2aa28648ac45,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b517f6-e9')
Nov 02 23:06:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Deleting instance files /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3_del
Nov 02 23:06:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Deletion of /opt/stack/data/nova/instances/80e598d8-a24f-412f-a083-3de7b0b853b3_del complete
Nov 02 23:06:01 user nova-compute[74721]: INFO nova.compute.manager [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 02 23:06:01 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:06:01 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received event network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] No waiting events found dispatching network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: WARNING nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received unexpected event network-vif-plugged-10901e7f-5971-4eb9-8a6d-509019ba3c79 for instance with vm_state building and task_state spawning.
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: WARNING nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state deleting.
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: WARNING nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state deleting.
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: WARNING nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state active and task_state deleting.
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-7caf0278-f430-45c9-b122-8cc3a31981e2 req-1dd84ec0-4e0e-44f5-abbe-66f3955a7d16 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-unplugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:06:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:06:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Instance spawned successfully.
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:06:03 user nova-compute[74721]: INFO nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:06:03 user nova-compute[74721]: INFO nova.compute.manager [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Took 7.04 seconds to build instance.
Nov 02 23:06:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e483079e-2759-4fc4-83fe-3c89d32421ba tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.165s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:03 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Took 1.51 seconds to deallocate network for instance.
Nov 02 23:06:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:03 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Deleted allocations for instance 80e598d8-a24f-412f-a083-3de7b0b853b3
Nov 02 23:06:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9c352880-0885-4140-bc5e-eb1ff1cf16a9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] Acquiring lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] Lock "80e598d8-a24f-412f-a083-3de7b0b853b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] No waiting events found dispatching network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:04 user nova-compute[74721]: WARNING nova.compute.manager [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received unexpected event network-vif-plugged-d0b517f6-e930-4e60-8193-2aa28648ac45 for instance with vm_state deleted and task_state None.
Nov 02 23:06:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-921ea0b4-812c-4b1e-815b-cf64449f56cd req-d9c8deae-2975-4eb3-9fe0-38b5f4e8e770 service nova] [instance: 80e598d8-a24f-412f-a083-3de7b0b853b3] Received event network-vif-deleted-d0b517f6-e930-4e60-8193-2aa28648ac45 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:08 user nova-compute[74721]: INFO nova.compute.manager [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Terminating instance
Nov 02 23:06:08 user nova-compute[74721]: DEBUG nova.compute.manager [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-2b1d33ee-481f-4757-8b78-2a6aaaa269c6 req-524fbc05-5ff4-4069-8bf4-5555f0ab39c0 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-unplugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:06:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Instance destroyed successfully.
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lazy-loading 'resources' on Instance uuid bb70b80b-ebf8-4962-afa2-49de93c5b3af {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-639869915',display_name='tempest-ServerActionsTestOtherB-server-639869915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-639869915',id=2,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIAJ2mZZ7OcMIqIRiJ9LWZVtlLXk504fM1Og4BlURRLNcbxwOH5N8+jx42oz/dFpFqYND9VPzRQCgOYz7uFdWWI29IlqbwtFfp0excV6ihbW0wJfgo7gt0gYmQOtPFAbw==',key_name='tempest-keypair-2137825781',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:03:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc43b8d380f489291403f7300e9a48c',ramdisk_id='',reservation_id='r-voyxw0ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-371613091',owner_user_name='tempest-ServerActionsTestOtherB-371613091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='821e324c9ed4485dbb9fd3d2200b6427',uuid=bb70b80b-ebf8-4962-afa2-49de93c5b3af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converting VIF {"id": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "address": "fa:16:3e:04:f7:98", "network": {"id": "3201771d-e957-414a-9cbc-89bb7aa8de59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-294679311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc43b8d380f489291403f7300e9a48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4d474-9e", "ovs_interfaceid": "e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_vif [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4d474-9e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95c49b4f-e250-479d-8060-4c1352f0d768) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:09 user nova-compute[74721]: INFO os_vif [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f7:98,bridge_name='br-int',has_traffic_filtering=True,id=e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd,network=Network(3201771d-e957-414a-9cbc-89bb7aa8de59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4d474-9e')
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqvZMEri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:06:09 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[018267c5-e232-42c0-8a46-9d8dace53313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:06:09 user nova-compute[74721]: No targets found.
Nov 02 23:06:09 user nova-compute[74721]: iSNS:
Nov 02 23:06:09 user nova-compute[74721]: No targets found.
Nov 02 23:06:09 user nova-compute[74721]: STATIC:
Nov 02 23:06:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b
Nov 02 23:06:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:06:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:06:09 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71
Nov 02 23:06:09 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:06:09 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:06:09 user nova-compute[74721]: FIRMWARE:
Nov 02 23:06:09 user nova-compute[74721]: No targets found.
Nov 02 23:06:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:06:09 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:06:09 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15cd61-0d1c-47ad-90e5-7109d1cb2bae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[47945440-3049-4ab0-b006-d1ee808ca829]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:06:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 (non-flash)
Nov 02 23:06:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243bec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c035d-456e-4fbe-93bf-cf46df550dcb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95af79a-02a0-43e2-86a2-b2e50618df1c]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8806408e-5c39-462d-8b10-58f7b993328c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2736e-9a5b-44e9-95fc-841aba57f0a2]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c18178-fe8c-4e5f-a673-ec9075508508]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b3ede-9e1d-4d9a-9e05-90773e4d457d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260]
Nov 02 23:06:09 user nova-compute[74721]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71, portal: 172.16.0.220,3260] successful.
Nov 02 23:06:09 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3e374a-a466-4f4f-90d5-8ca9f921cf71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeae99e-7cb8-432e-b542-223875e2e2b3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] <== disconnect_volume: return (396ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:06:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Deleting instance files /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_del
Nov 02 23:06:09 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Deletion of /opt/stack/data/nova/instances/bb70b80b-ebf8-4962-afa2-49de93c5b3af_del complete
Nov 02 23:06:09 user nova-compute[74721]: INFO nova.compute.manager [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 02 23:06:09 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:06:09 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:10 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Took 0.93 seconds to deallocate network for instance.
Nov 02 23:06:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-d5b10538-1b89-4b60-b000-0f0561f3ddee req-0c338992-18b4-4fa3-8ca1-18612401fed7 service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-deleted-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] Acquiring lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] No waiting events found dispatching network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:10 user nova-compute[74721]: WARNING nova.compute.manager [req-0a536b05-1560-49a2-8597-51f2fded728d req-71d5a720-cea1-418d-97a8-0001bc6ac93d service nova] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Received unexpected event network-vif-plugged-e4e4d474-9e33-4c8c-ab08-76e3dc0e9ebd for instance with vm_state active and task_state deleting.
Nov 02 23:06:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:17 user nova-compute[74721]: INFO nova.compute.manager [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] [instance: bb70b80b-ebf8-4962-afa2-49de93c5b3af] Took 6.91 seconds to detach 1 volumes for instance.
Nov 02 23:06:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:17 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:17 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:18 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Deleted allocations for instance bb70b80b-ebf8-4962-afa2-49de93c5b3af
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-71ac7769-b34a-42ce-ba80-30f6e5cf7c63 tempest-ServerActionsTestOtherB-371613091 tempest-ServerActionsTestOtherB-371613091-project-member] Lock "bb70b80b-ebf8-4962-afa2-49de93c5b3af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.027s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:18 user nova-compute[74721]: INFO nova.compute.manager [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Terminating instance
Nov 02 23:06:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-unplugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] No waiting events found dispatching network-vif-unplugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2f59835-445c-4ecb-bb2b-4c04ae996a30 req-73788906-9d5a-4e15-bb8d-0d8c8e0e2627 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-unplugged-71b32ddb-eedb-465d-a62e-07e78cec625f for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:06:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Instance destroyed successfully.
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.objects.instance [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lazy-loading 'resources' on Instance uuid de639e34-1cd6-4e18-b086-ea4f0303eeb6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1300282949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1300282',id=15,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDf2rJU9+f3GOFgZcghJrlAbiteSej9yMElJzWqTDi5KTF4xXZD0MIphkn1VfpUqUYjdynQnt2hr8RELkeHCrsJB9sRkZu3nmHQI3MVP9eVH1zVbpnpm50SJE5EIv/L8A==',key_name='tempest-keypair-737818048',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6a0a54ffad484facd7e9c8d9a2c029',ramdisk_id='',reservation_id='r-6carlhl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce6a847827d4c68a59c5753c3ce39f9',uuid=de639e34-1cd6-4e18-b086-ea4f0303eeb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converting VIF {"id": "71b32ddb-eedb-465d-a62e-07e78cec625f", "address": "fa:16:3e:eb:fe:c1", "network": {"id": "1a9efc8e-0783-4f54-bbcf-21cc5f594cb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1341333218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6a0a54ffad484facd7e9c8d9a2c029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b32ddb-ee", "ovs_interfaceid": "71b32ddb-eedb-465d-a62e-07e78cec625f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG os_vif [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71b32ddb-ee, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=274b6cd9-63e5-4fa7-b1ea-fdd1a429f321) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:19 user nova-compute[74721]: INFO os_vif [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fe:c1,bridge_name='br-int',has_traffic_filtering=True,id=71b32ddb-eedb-465d-a62e-07e78cec625f,network=Network(1a9efc8e-0783-4f54-bbcf-21cc5f594cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b32ddb-ee')
Nov 02 23:06:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Deleting instance files /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6_del
Nov 02 23:06:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Deletion of /opt/stack/data/nova/instances/de639e34-1cd6-4e18-b086-ea4f0303eeb6_del complete
Nov 02 23:06:19 user nova-compute[74721]: INFO nova.compute.manager [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 req-5c5c9eff-559c-43eb-b14f-a8be85f40ffe service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event volume-reimaged-e3a8516e-8593-40fb-a8cf-8d35b64ed56b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 req-5c5c9eff-559c-43eb-b14f-a8be85f40ffe service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 req-5c5c9eff-559c-43eb-b14f-a8be85f40ffe service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 req-5c5c9eff-559c-43eb-b14f-a8be85f40ffe service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 req-5c5c9eff-559c-43eb-b14f-a8be85f40ffe service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Processing event volume-reimaged-e3a8516e-8593-40fb-a8cf-8d35b64ed56b {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance event wait completed in 58 seconds for volume-reimaged {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:06:19 user nova-compute[74721]: INFO nova.virt.block_device [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Booting with volume e3a8516e-8593-40fb-a8cf-8d35b64ed56b at /dev/vda
Nov 02 23:06:19 user nova-compute[74721]: DEBUG os_brick.utils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0297685-67d5-4fac-89cd-088c9cc8f82a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd28512-18c6-4eb6-9a7f-e9921d792444]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce8a8e-9ebe-4d6c-a621-be1fe7d4966e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9de4b4-0784-40fa-a4cd-05916202f96e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:06:20 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc164404-95ff-488f-b945-b95e52c390ce]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG os_brick.utils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating existing volume attachment record: 01fc8cf9-be62-43c3-a5a7-9b61eb96e34f {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:20 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Took 1.05 seconds to deallocate network for instance.
Nov 02 23:06:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-edc1638e-8833-4ff6-8a04-e7d402340889 req-03c8e336-316b-4c6f-bf50-565c373fe971 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-deleted-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:20 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:21 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Deleted allocations for instance de639e34-1cd6-4e18-b086-ea4f0303eeb6
Nov 02 23:06:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-436a3c7f-7391-4a2f-b886-2ab35b0dffce tempest-TestServerVolumeAttachScenarioOldVersion-606342397 tempest-TestServerVolumeAttachScenarioOldVersion-606342397-project-member] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.519s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] Acquiring lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] Lock "de639e34-1cd6-4e18-b086-ea4f0303eeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] No waiting events found dispatching network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:21 user nova-compute[74721]: WARNING nova.compute.manager [req-4596165e-0de0-4e29-8fc0-1193b327b3ef req-6f5f1fa3-ad9e-4138-a5f1-99057ed70136 service nova] [instance: de639e34-1cd6-4e18-b086-ea4f0303eeb6] Received unexpected event network-vif-plugged-71b32ddb-eedb-465d-a62e-07e78cec625f for instance with vm_state deleted and task_state None.
Nov 02 23:06:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkEvNlUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:06:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:06:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:06:23 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8c2c01-f74b-41db-a6dd-726356275cf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:06:23 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18d98b-8ff0-48fc-8c7b-3ccf4860eb21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df] added
Nov 02 23:06:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf37983-d56d-40bc-9042-7ac895e6ef26]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c05c87-47b2-4abb-ba26-3dc98fda5a8d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkEvNlUs {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkEvNlUs" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc86a0a-67f8-465f-868b-6e876a0da59b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkEvNlUs'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd219df-a74d-45f1-b28b-a9e728af2d7f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[302aa417-c375-4af3-9d9d-42f36e8d1cec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:06:23 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:06:23 user nova-compute[74721]:  {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:06:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 23:06:23 user nova-compute[74721]: 
Nov 02 23:06:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238264c-8aab-4f93-ba84-c5a38c5f7062]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260]
Nov 02 23:06:24 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260] successful.
Nov 02 23:06:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b89dc9-223e-494f-90a2-dc82509942e0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9e329a-0433-4607-853f-0b678dae00cd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)
Nov 02 23:06:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)
Nov 02 23:06:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8bf4b-d297-44b1-9f15-677582905449]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkEvNlUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:06:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26562353332323764', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562353332323764', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lazy-loading 'flavor' on Instance uuid b91ab94a-82ca-45c9-84b8-b2d28eae9a72 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:06:25 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:06:25 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:06:25 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:06:25 user nova-compute[74721]:   <serial>39da4a76-88cb-4633-a0cb-012dedf6e6df</serial>
Nov 02 23:06:25 user nova-compute[74721]: </disk>
Nov 02 23:06:25 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] No VIF found with MAC fa:16:3e:cf:b6:4b, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d95cf2b9-af1c-4e7d-8800-a2b03c9c651e tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 73.492s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:26 user nova-compute[74721]: INFO nova.compute.manager [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Terminating instance
Nov 02 23:06:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-unplugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] No waiting events found dispatching network-vif-unplugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-c541ec66-f7b9-425d-935c-c4341ea98207 req-f812991d-73e3-426e-b790-18b9bc6f6dcb service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-unplugged-c54158bb-77eb-4c50-abba-922bfd18ecea for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:06:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Instance destroyed successfully.
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lazy-loading 'resources' on Instance uuid b91ab94a-82ca-45c9-84b8-b2d28eae9a72 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-493728230',display_name='tempest-DeleteServersTestJSON-server-493728230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-493728230',id=16,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='538e30ac1b4346489c46c6490e3bcc81',ramdisk_id='',reservation_id='r-pjd57ut5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-165672183',owner_user_name='tempest-DeleteServersTestJSON-165672183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:03:21Z,user_data=None,user_id='0ba59bab70c94cdab38eb64b0774e559',uuid=b91ab94a-82ca-45c9-84b8-b2d28eae9a72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converting VIF {"id": "c54158bb-77eb-4c50-abba-922bfd18ecea", "address": "fa:16:3e:cf:b6:4b", "network": {"id": "b5a22bb7-3053-4480-b49f-920fc4e5268c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-721468031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538e30ac1b4346489c46c6490e3bcc81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54158bb-77", "ovs_interfaceid": "c54158bb-77eb-4c50-abba-922bfd18ecea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_vif [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc54158bb-77, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aba6ea69-448f-42a3-9605-39169ccc0c3b) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:27 user nova-compute[74721]: INFO os_vif [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=c54158bb-77eb-4c50-abba-922bfd18ecea,network=Network(b5a22bb7-3053-4480-b49f-920fc4e5268c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54158bb-77')
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkEvNlUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:06:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[330a7b8e-55b9-4022-9c10-dc0e205abb3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:06:27 user nova-compute[74721]: No targets found.
Nov 02 23:06:27 user nova-compute[74721]: iSNS:
Nov 02 23:06:27 user nova-compute[74721]: No targets found.
Nov 02 23:06:27 user nova-compute[74721]: STATIC:
Nov 02 23:06:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df
Nov 02 23:06:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:06:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:06:27 user nova-compute[74721]: FIRMWARE:
Nov 02 23:06:27 user nova-compute[74721]: No targets found.
Nov 02 23:06:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:06:27 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:06:27 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f138318-ba8c-4485-8db0-a85c97f46b50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df152a-2a03-4422-92f0-992ca32acbd9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)
Nov 02 23:06:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df (non-flash)
Nov 02 23:06:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c1cd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[715bf102-07bc-467d-8dbc-a9aaa317ff6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[67897120-ad70-450f-99d1-946eda370262]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05154a0-8a56-4d73-a124-0e7f74b637aa]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c0a59d-0de6-4874-a0f8-e0ee97beb9b1]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2c4ea-e6b1-4d48-99d1-f27924d80dec]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fbcecb-b2f6-4086-9457-bbeef5393fdc]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260]
Nov 02 23:06:27 user nova-compute[74721]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df, portal: 172.16.0.220,3260] successful.
Nov 02 23:06:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da4a76-88cb-4633-a0cb-012dedf6e6df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a07fb-5a58-42c0-a590-6fdb7066ef89]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] <== disconnect_volume: return (349ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:06:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Deleting instance files /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72_del
Nov 02 23:06:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Deletion of /opt/stack/data/nova/instances/b91ab94a-82ca-45c9-84b8-b2d28eae9a72_del complete
Nov 02 23:06:27 user nova-compute[74721]: INFO nova.compute.manager [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Took 1.73 seconds to destroy the instance on the hypervisor.
Nov 02 23:06:27 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:06:27 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:06:28 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-a9fe840e-bb73-47d4-86d3-b86f75345f6d req-7e38949f-1320-42ad-8c38-93276ce9e6e8 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-deleted-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:28 user nova-compute[74721]: INFO nova.compute.manager [req-a9fe840e-bb73-47d4-86d3-b86f75345f6d req-7e38949f-1320-42ad-8c38-93276ce9e6e8 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Neutron deleted interface c54158bb-77eb-4c50-abba-922bfd18ecea; detaching it from the instance and deleting it from the info cache
Nov 02 23:06:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-a9fe840e-bb73-47d4-86d3-b86f75345f6d req-7e38949f-1320-42ad-8c38-93276ce9e6e8 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:28 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Took 0.75 seconds to deallocate network for instance.
Nov 02 23:06:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-a9fe840e-bb73-47d4-86d3-b86f75345f6d req-7e38949f-1320-42ad-8c38-93276ce9e6e8 service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Detach interface failed, port_id=c54158bb-77eb-4c50-abba-922bfd18ecea, reason: Instance b91ab94a-82ca-45c9-84b8-b2d28eae9a72 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] Acquiring lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] No waiting events found dispatching network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:29 user nova-compute[74721]: WARNING nova.compute.manager [req-3a1ba735-d8b8-4014-a331-2f8240c550ab req-61b50893-8b7f-40da-a9a1-0adebddb440f service nova] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Received unexpected event network-vif-plugged-c54158bb-77eb-4c50-abba-922bfd18ecea for instance with vm_state active and task_state deleting.
Nov 02 23:06:29 user nova-compute[74721]: INFO nova.compute.manager [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] [instance: b91ab94a-82ca-45c9-84b8-b2d28eae9a72] Took 0.95 seconds to detach 1 volumes for instance.
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:29 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Deleted allocations for instance b91ab94a-82ca-45c9-84b8-b2d28eae9a72
Nov 02 23:06:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fcd56c5e-7788-4cf3-80aa-3f259ce50751 tempest-DeleteServersTestJSON-165672183 tempest-DeleteServersTestJSON-165672183-project-member] Lock "b91ab94a-82ca-45c9-84b8-b2d28eae9a72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.959s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:06:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:06:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8123MB free_disk=25.556396484375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 71d0fd0d-73ca-4921-9064-c9d70f98cc8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:06:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:06:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:06:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:06:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:06:54 user nova-compute[74721]: INFO nova.compute.claims [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Claim successful on node user
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:06:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.policy [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce9460acd644a25a9c32ade02941243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca4498dfb724e13ba1086d4e687d1ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:06:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Creating image(s)
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "/opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "/opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk 1073741824" returned: 0 in 0.071s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Successfully created port: f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Cannot resize image /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Ensure instance console log exists: /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Successfully updated port: f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquired lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-changed-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Refreshing instance network info cache due to event network-changed-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] Acquiring lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:06:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating instance_info_cache with network_info: [{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Releasing lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Instance network_info: |[{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] Acquired lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.neutron [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Refreshing network info cache for port f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Start _get_guest_xml network_info=[{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:06:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:06:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118640126',display_name='tempest-AttachVolumeTestJSON-server-2118640126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118640126',id=21,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtfRffVls0PcAydumm1YRg2xkK+1fMqVCgmqPsNoyYT+0hH8rj+jFHXVhVxRstTE0fyODJInyV8RdIfSjjG9aLQ1tDDNHMVgxFONyIw256OllvrKf4WJ3HgTc5dVt/9kg==',key_name='tempest-keypair-629746875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-qvnkg1bl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=ec739fdb-b759-473d-8091-7421604b8a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'pci_devices' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:06:57 user nova-compute[74721]:   <uuid>ec739fdb-b759-473d-8091-7421604b8a50</uuid>
Nov 02 23:06:57 user nova-compute[74721]:   <name>instance-00000015</name>
Nov 02 23:06:57 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:06:57 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:06:57 user nova-compute[74721]:   <metadata>
Nov 02 23:06:57 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:06:57 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeTestJSON-server-2118640126</nova:name>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:06:57</nova:creationTime>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:06:57 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:06:57 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:owner>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:user uuid="6ce9460acd644a25a9c32ade02941243">tempest-AttachVolumeTestJSON-1894655503-project-member</nova:user>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:project uuid="bca4498dfb724e13ba1086d4e687d1ef">tempest-AttachVolumeTestJSON-1894655503</nova:project>
Nov 02 23:06:57 user nova-compute[74721]:       </nova:owner>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:06:57 user nova-compute[74721]:       <nova:ports>
Nov 02 23:06:57 user nova-compute[74721]:         <nova:port uuid="f0d8ff07-87d6-4051-9f49-e4d2fecf1f61">
Nov 02 23:06:57 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 23:06:57 user nova-compute[74721]:         </nova:port>
Nov 02 23:06:57 user nova-compute[74721]:       </nova:ports>
Nov 02 23:06:57 user nova-compute[74721]:     </nova:instance>
Nov 02 23:06:57 user nova-compute[74721]:   </metadata>
Nov 02 23:06:57 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:06:57 user nova-compute[74721]:     <system>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="serial">ec739fdb-b759-473d-8091-7421604b8a50</entry>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="uuid">ec739fdb-b759-473d-8091-7421604b8a50</entry>
Nov 02 23:06:57 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:06:57 user nova-compute[74721]:     </system>
Nov 02 23:06:57 user nova-compute[74721]:   </sysinfo>
Nov 02 23:06:57 user nova-compute[74721]:   <os>
Nov 02 23:06:57 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:06:57 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:06:57 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:06:57 user nova-compute[74721]:   </os>
Nov 02 23:06:57 user nova-compute[74721]:   <features>
Nov 02 23:06:57 user nova-compute[74721]:     <acpi/>
Nov 02 23:06:57 user nova-compute[74721]:     <apic/>
Nov 02 23:06:57 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:06:57 user nova-compute[74721]:   </features>
Nov 02 23:06:57 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:06:57 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:06:57 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:06:57 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:06:57 user nova-compute[74721]:   </clock>
Nov 02 23:06:57 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:06:57 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:06:57 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:06:57 user nova-compute[74721]:   </cpu>
Nov 02 23:06:57 user nova-compute[74721]:   <devices>
Nov 02 23:06:57 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:06:57 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:06:57 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk"/>
Nov 02 23:06:57 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:06:57 user nova-compute[74721]:     </disk>
Nov 02 23:06:57 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:06:57 user nova-compute[74721]:       <mac address="fa:16:3e:c8:6f:19"/>
Nov 02 23:06:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:06:57 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:06:57 user nova-compute[74721]:       <target dev="tapf0d8ff07-87"/>
Nov 02 23:06:57 user nova-compute[74721]:     </interface>
Nov 02 23:06:57 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:06:57 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/console.log" append="off"/>
Nov 02 23:06:57 user nova-compute[74721]:     </serial>
Nov 02 23:06:57 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:06:57 user nova-compute[74721]:     <video>
Nov 02 23:06:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:06:57 user nova-compute[74721]:     </video>
Nov 02 23:06:57 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:06:57 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:06:57 user nova-compute[74721]:     </rng>
Nov 02 23:06:57 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:06:57 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:06:57 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:06:57 user nova-compute[74721]:     </memballoon>
Nov 02 23:06:57 user nova-compute[74721]:   </devices>
Nov 02 23:06:57 user nova-compute[74721]: </domain>
Nov 02 23:06:57 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118640126',display_name='tempest-AttachVolumeTestJSON-server-2118640126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118640126',id=21,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtfRffVls0PcAydumm1YRg2xkK+1fMqVCgmqPsNoyYT+0hH8rj+jFHXVhVxRstTE0fyODJInyV8RdIfSjjG9aLQ1tDDNHMVgxFONyIw256OllvrKf4WJ3HgTc5dVt/9kg==',key_name='tempest-keypair-629746875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-qvnkg1bl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=ec739fdb-b759-473d-8091-7421604b8a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG os_vif [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e31d7a0-bb1c-5178-85fd-11d278a5479b', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0d8ff07-87, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0d8ff07-87, col_values=(('qos', UUID('67e94184-f452-4803-9545-7b86e5ac3bff')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0d8ff07-87, col_values=(('external_ids', {'iface-id': 'f0d8ff07-87d6-4051-9f49-e4d2fecf1f61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:6f:19', 'vm-uuid': 'ec739fdb-b759-473d-8091-7421604b8a50'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:57 user nova-compute[74721]: INFO os_vif [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87')
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:06:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No VIF found with MAC fa:16:3e:c8:6f:19, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:06:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updated VIF entry in instance network info cache for port f0d8ff07-87d6-4051-9f49-e4d2fecf1f61. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:06:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating instance_info_cache with network_info: [{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:06:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1893e2d2-1f08-4d8b-b45f-1bcc3677aa19 req-5bdcf072-f4e5-436e-aed2-2e1c52f3b953 service nova] Releasing lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:06:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] No waiting events found dispatching network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:06:59 user nova-compute[74721]: WARNING nova.compute.manager [req-29f9d2f5-ff2a-4eb7-a14b-6e24aca8d0b4 req-0e20cf27-3b1c-4d54-aaa8-f60663fcf1dc service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received unexpected event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 for instance with vm_state building and task_state spawning.
Nov 02 23:06:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] No waiting events found dispatching network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:01 user nova-compute[74721]: WARNING nova.compute.manager [req-c85c9f48-3da6-4ebe-b6cf-fe733053a3fa req-0df53aff-55ee-490b-9220-3a74fd00d4e5 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received unexpected event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 for instance with vm_state building and task_state spawning.
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:07:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Instance spawned successfully.
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:01 user nova-compute[74721]: INFO nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 02 23:07:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:07:01 user nova-compute[74721]: INFO nova.compute.manager [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Took 7.08 seconds to build instance.
Nov 02 23:07:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c3135aa3-d3d9-4aa0-827c-0daa9358d8b7 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.195s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:03 user nova-compute[74721]: INFO nova.compute.claims [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Claim successful on node user
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Creating image(s)
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "/opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "/opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "/opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG nova.policy [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098f64e0da7c457e8845a970d41294b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52745a8a23e0448c8e9e484dc3fc1ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.254s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk 1073741824" returned: 0 in 0.058s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:07:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Cannot resize image /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Ensure instance console log exists: /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Successfully created port: d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Successfully updated port: d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquired lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-changed-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Refreshing instance network info cache due to event network-changed-d90c976e-9859-4d95-9a13-6dcb5d46724f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] Acquiring lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updating instance_info_cache with network_info: [{"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Releasing lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Instance network_info: |[{"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] Acquired lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Refreshing network info cache for port d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Start _get_guest_xml network_info=[{"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2073498056',display_name='tempest-VolumesSnapshotTestJSON-instance-2073498056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2073498056',id=22,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyDedSSdrxcKOPHnt2z46UFkzF2O0LdBLTLoGLE+VpYRnNX9xAh3Wm9ssM8EXr8x6k56PlmSMCGsfKOKE3NP8Otj5ddv/skpF0ZQP3jK4oogEXU8pSM/CzTjhcjn5bluQ==',key_name='tempest-keypair-1895928751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-3ib7ivbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=81b931c4-19b3-4a02-b002-bd3791508385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'pci_devices' on Instance uuid 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:06 user nova-compute[74721]:   <uuid>81b931c4-19b3-4a02-b002-bd3791508385</uuid>
Nov 02 23:07:06 user nova-compute[74721]:   <name>instance-00000016</name>
Nov 02 23:07:06 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:06 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:06 user nova-compute[74721]:   <metadata>
Nov 02 23:07:06 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:06 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2073498056</nova:name>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:06</nova:creationTime>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:06 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:06 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:user uuid="098f64e0da7c457e8845a970d41294b9">tempest-VolumesSnapshotTestJSON-372484288-project-member</nova:user>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:project uuid="52745a8a23e0448c8e9e484dc3fc1ac4">tempest-VolumesSnapshotTestJSON-372484288</nova:project>
Nov 02 23:07:06 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:07:06 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:06 user nova-compute[74721]:         <nova:port uuid="d90c976e-9859-4d95-9a13-6dcb5d46724f">
Nov 02 23:07:06 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 23:07:06 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:06 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:06 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:06 user nova-compute[74721]:   </metadata>
Nov 02 23:07:06 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:06 user nova-compute[74721]:     <system>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="serial">81b931c4-19b3-4a02-b002-bd3791508385</entry>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="uuid">81b931c4-19b3-4a02-b002-bd3791508385</entry>
Nov 02 23:07:06 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:06 user nova-compute[74721]:     </system>
Nov 02 23:07:06 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:06 user nova-compute[74721]:   <os>
Nov 02 23:07:06 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:06 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:06 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:06 user nova-compute[74721]:   </os>
Nov 02 23:07:06 user nova-compute[74721]:   <features>
Nov 02 23:07:06 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:06 user nova-compute[74721]:     <apic/>
Nov 02 23:07:06 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:06 user nova-compute[74721]:   </features>
Nov 02 23:07:06 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:06 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:06 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:06 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:06 user nova-compute[74721]:   </clock>
Nov 02 23:07:06 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:06 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:06 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:06 user nova-compute[74721]:   </cpu>
Nov 02 23:07:06 user nova-compute[74721]:   <devices>
Nov 02 23:07:06 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:07:06 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:07:06 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk"/>
Nov 02 23:07:06 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:06 user nova-compute[74721]:     </disk>
Nov 02 23:07:06 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:06 user nova-compute[74721]:       <mac address="fa:16:3e:e5:a9:75"/>
Nov 02 23:07:06 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:06 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:06 user nova-compute[74721]:       <target dev="tapd90c976e-98"/>
Nov 02 23:07:06 user nova-compute[74721]:     </interface>
Nov 02 23:07:06 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:06 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/console.log" append="off"/>
Nov 02 23:07:06 user nova-compute[74721]:     </serial>
Nov 02 23:07:06 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:06 user nova-compute[74721]:     <video>
Nov 02 23:07:06 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:06 user nova-compute[74721]:     </video>
Nov 02 23:07:06 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:06 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:06 user nova-compute[74721]:     </rng>
Nov 02 23:07:06 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:06 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:06 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:06 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:06 user nova-compute[74721]:   </devices>
Nov 02 23:07:06 user nova-compute[74721]: </domain>
Nov 02 23:07:06 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2073498056',display_name='tempest-VolumesSnapshotTestJSON-instance-2073498056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2073498056',id=22,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyDedSSdrxcKOPHnt2z46UFkzF2O0LdBLTLoGLE+VpYRnNX9xAh3Wm9ssM8EXr8x6k56PlmSMCGsfKOKE3NP8Otj5ddv/skpF0ZQP3jK4oogEXU8pSM/CzTjhcjn5bluQ==',key_name='tempest-keypair-1895928751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-3ib7ivbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=81b931c4-19b3-4a02-b002-bd3791508385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG os_vif [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '946676ac-e13a-5804-9643-3a26ed04b78e', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd90c976e-98, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd90c976e-98, col_values=(('qos', UUID('716e0bdd-1e4f-4118-a947-9fdef2573e3f')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd90c976e-98, col_values=(('external_ids', {'iface-id': 'd90c976e-9859-4d95-9a13-6dcb5d46724f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a9:75', 'vm-uuid': '81b931c4-19b3-4a02-b002-bd3791508385'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:06 user nova-compute[74721]: INFO os_vif [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98')
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No VIF found with MAC fa:16:3e:e5:a9:75, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updated VIF entry in instance network info cache for port d90c976e-9859-4d95-9a13-6dcb5d46724f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updating instance_info_cache with network_info: [{"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-da02921c-3ea9-4e22-a2e3-0c97d47e34e6 req-752cf87a-f587-49d1-a5ab-05c0d8a4a7c1 service nova] Releasing lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Creating image(s)
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Ensure instance console log exists: /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start _get_guest_xml network_info=[{"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '01fc8cf9-be62-43c3-a5a7-9b61eb96e34f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f645085b-cb51-4134-ad75-b635ff687ed2', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'serial': 'e3a8516e-8593-40fb-a8cf-8d35b64ed56b'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:07 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 23:07:07 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lazy-loading 'vcpu_model' on Instance uuid f645085b-cb51-4134-ad75-b635ff687ed2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:07:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:07:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:07:07 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f4619-25d8-4695-a815-531fbff63769]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:07:07 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181b2ac-b395-492c-85a6-2934cc7e3754]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b] added
Nov 02 23:07:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b56a0-3ffe-455b-bdc1-4e31aec3bf86]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc82dda7-22c6-46bf-859e-50112285610a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaUThtMP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaUThtMP" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac906c19-4e0c-4001-a7dc-1cffa7a943f8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FaUThtMP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a5ac6-9d7a-452a-a04e-af00ece38ec9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeafd17f-3342-4b85-bc7e-770432f373ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:07:07 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:07:07 user nova-compute[74721]:  {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:07:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 23:07:07 user nova-compute[74721]: : NotImplementedError
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4a929-f48d-44df-8b2b-399f7e1075a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]
Nov 02 23:07:07 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.
Nov 02 23:07:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90136e0-4b7a-44c9-882f-dfc361f53878]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1273d-309e-46c3-84a3-cdbfbc4ba625]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8829dbd8-6299-4137-b707-2cf450ae1400]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:07:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-changed-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Refreshing instance network info cache due to event network-changed-ba4c963e-8ead-4200-8ff3-805e08aa0460. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] Acquiring lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] Acquired lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Refreshing network info cache for port ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] No waiting events found dispatching network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:08 user nova-compute[74721]: WARNING nova.compute.manager [req-53f0767c-0882-445d-8d3c-85fd457aff16 req-9f2027b5-0067-4241-8260-0ac22e2d426b service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received unexpected event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f for instance with vm_state building and task_state spawning.
Nov 02 23:07:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26561383138643638', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561383138643638', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-342025052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:08 user nova-compute[74721]:   <uuid>f645085b-cb51-4134-ad75-b635ff687ed2</uuid>
Nov 02 23:07:08 user nova-compute[74721]:   <name>instance-00000011</name>
Nov 02 23:07:08 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:08 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:08 user nova-compute[74721]:   <metadata>
Nov 02 23:07:08 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:08 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:08 user nova-compute[74721]:       <nova:name>tempest-ServerActionsV293TestJSON-server-342025052</nova:name>
Nov 02 23:07:08 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:07</nova:creationTime>
Nov 02 23:07:08 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:08 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:08 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:08 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:user uuid="c2979ae9ac194589921de6ba94e576d3">tempest-ServerActionsV293TestJSON-540561610-project-member</nova:user>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:project uuid="12a31f16591d4189bd728b4d69175796">tempest-ServerActionsV293TestJSON-540561610</nova:project>
Nov 02 23:07:08 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:08 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:08 user nova-compute[74721]:         <nova:port uuid="5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f">
Nov 02 23:07:08 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:07:08 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:08 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:08 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:08 user nova-compute[74721]:   </metadata>
Nov 02 23:07:08 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:08 user nova-compute[74721]:     <system>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="serial">f645085b-cb51-4134-ad75-b635ff687ed2</entry>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="uuid">f645085b-cb51-4134-ad75-b635ff687ed2</entry>
Nov 02 23:07:08 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:08 user nova-compute[74721]:     </system>
Nov 02 23:07:08 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:08 user nova-compute[74721]:   <os>
Nov 02 23:07:08 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:08 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:08 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:08 user nova-compute[74721]:   </os>
Nov 02 23:07:08 user nova-compute[74721]:   <features>
Nov 02 23:07:08 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:08 user nova-compute[74721]:     <apic/>
Nov 02 23:07:08 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:08 user nova-compute[74721]:   </features>
Nov 02 23:07:08 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:08 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:08 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:08 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:08 user nova-compute[74721]:   </clock>
Nov 02 23:07:08 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:08 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:08 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:08 user nova-compute[74721]:   </cpu>
Nov 02 23:07:08 user nova-compute[74721]:   <devices>
Nov 02 23:07:08 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:07:08 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:07:08 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:07:08 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:08 user nova-compute[74721]:       <serial>e3a8516e-8593-40fb-a8cf-8d35b64ed56b</serial>
Nov 02 23:07:08 user nova-compute[74721]:     </disk>
Nov 02 23:07:08 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:08 user nova-compute[74721]:       <mac address="fa:16:3e:ac:f0:b6"/>
Nov 02 23:07:08 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:08 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:08 user nova-compute[74721]:       <target dev="tap5f07a5be-f2"/>
Nov 02 23:07:08 user nova-compute[74721]:     </interface>
Nov 02 23:07:08 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:08 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2/console.log" append="off"/>
Nov 02 23:07:08 user nova-compute[74721]:     </serial>
Nov 02 23:07:08 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:08 user nova-compute[74721]:     <video>
Nov 02 23:07:08 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:08 user nova-compute[74721]:     </video>
Nov 02 23:07:08 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:08 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:08 user nova-compute[74721]:     </rng>
Nov 02 23:07:08 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:08 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:08 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:08 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:08 user nova-compute[74721]:   </devices>
Nov 02 23:07:08 user nova-compute[74721]: </domain>
Nov 02 23:07:08 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-342025052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG os_vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '781028e6-bbeb-5f98-a2f9-2d14c4048fdb', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f07a5be-f2, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f07a5be-f2, col_values=(('qos', UUID('9b81ed01-c174-4221-994c-861c240c9cd4')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f07a5be-f2, col_values=(('external_ids', {'iface-id': '5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:f0:b6', 'vm-uuid': 'f645085b-cb51-4134-ad75-b635ff687ed2'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: INFO os_vif [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2')
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] No VIF found with MAC fa:16:3e:ac:f0:b6, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updated VIF entry in instance network info cache for port ba4c963e-8ead-4200-8ff3-805e08aa0460. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating instance_info_cache with network_info: [{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd2b68b7-f403-427f-bff9-9717476ecf8f req-85d048cb-bc10-45a2-9608-47357ccd1eeb service nova] Releasing lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] No waiting events found dispatching network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:10 user nova-compute[74721]: WARNING nova.compute.manager [req-7ecd75b6-492d-4e71-8465-bb86b93ab54d req-b60ee7a4-7288-40a4-8e02-8a9f4b0856d5 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received unexpected event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f for instance with vm_state building and task_state spawning.
Nov 02 23:07:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:10 user nova-compute[74721]: WARNING nova.compute.manager [req-f5d88c6b-e874-468a-91f3-9b0c73039de9 req-05e15eb7-ffec-4f56-a4e5-1e2fe80b79d7 service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state active and task_state rebuild_spawning.
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:07:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Instance spawned successfully.
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:11 user nova-compute[74721]: INFO nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 02 23:07:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:11 user nova-compute[74721]: INFO nova.compute.manager [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Took 8.07 seconds to build instance.
Nov 02 23:07:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-db6d333c-d9a7-4f71-8987-bb5ba17348b0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.183s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:12 user nova-compute[74721]: WARNING nova.compute.manager [req-319be884-84f8-4704-b00d-7e0924f4be40 req-3e182209-a9c9-4306-a14b-7a13bce7892b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state active and task_state rebuild_spawning.
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:07:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance spawned successfully.
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74721) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 23:07:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ac4b4e89-d4e2-4239-8036-b5a4a89a8e25 tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG nova.objects.instance [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:20 user nova-compute[74721]: INFO nova.compute.manager [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Attaching volume 9345b923-ff59-4252-8d43-6df06775e0eb to /dev/vdb
Nov 02 23:07:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG os_brick.utils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b127ea83-60b2-48ec-9731-544c02412f96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb0c18b-b3f9-48a8-801d-3d7fc39b0bda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23d165-d521-49c3-be53-9b2911c6967e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[524e07c5-867c-4268-a2f7-0c21dc611997]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:07:21 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:07:21 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf197bc4-435e-41d0-b601-d0514105c8c9]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG os_brick.utils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:07:21 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating existing volume attachment record: 3af01b8c-af75-4862-9b52-69c58a7f69c7 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:07:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:27 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:07:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:07:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:07:31 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:07:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:37 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.4759521484375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 71d0fd0d-73ca-4921-9064-c9d70f98cc8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ec739fdb-b759-473d-8091-7421604b8a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 81b931c4-19b3-4a02-b002-bd3791508385 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:07:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:42 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:42 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:42 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:07:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:07:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:46 user nova-compute[74721]: INFO nova.compute.manager [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Terminating instance
Nov 02 23:07:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Instance destroyed successfully.
Nov 02 23:07:46 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lazy-loading 'resources' on Instance uuid 71d0fd0d-73ca-4921-9064-c9d70f98cc8f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-114835058',display_name='tempest-ServersNegativeTestJSON-server-114835058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-114835058',id=20,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-r4u0rn5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:06:03Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=71d0fd0d-73ca-4921-9064-c9d70f98cc8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "address": "fa:16:3e:6f:c6:66", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10901e7f-59", "ovs_interfaceid": "10901e7f-5971-4eb9-8a6d-509019ba3c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG os_vif [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10901e7f-59, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33018d93-1610-424d-ace9-787b8d146dd8) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:46 user nova-compute[74721]: INFO os_vif [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=10901e7f-5971-4eb9-8a6d-509019ba3c79,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10901e7f-59')
Nov 02 23:07:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Deleting instance files /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f_del
Nov 02 23:07:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Deletion of /opt/stack/data/nova/instances/71d0fd0d-73ca-4921-9064-c9d70f98cc8f_del complete
Nov 02 23:07:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQClZaFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:07:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:07:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:07:47 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75653447-fba5-4eb4-893e-1a4b61b190de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:07:47 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: INFO nova.compute.manager [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c3af2f-bea7-4ddd-bde9-220ed2517bf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb] added
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e043b4-5869-4317-8420-703dbdfdadc1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d06978-9d5d-4f29-8ef5-78390da8e933]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQClZaFK {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQClZaFK" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e2901-02fa-40c1-8b84-4b7854a68454]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IQClZaFK'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4598e5e7-13e9-4870-aa13-3702c0bb8928]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2522f8-d3eb-4b43-990d-efac411d4e79]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91326ff-58d9-4d74-aa11-6223baa21e9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260]
Nov 02 23:07:47 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260] successful.
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc95d897-5714-4b11-88a1-89b387abf541]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad44f15-5867-478d-be44-670053d6988e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:47 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:07:47 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:07:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9a391-23b8-44cb-9b9c-f3aeb390a615]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:07:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQClZaFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:48 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Took 1.06 seconds to deallocate network for instance.
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-38c1ba21-fada-4f1e-92e1-9c10279fd401 req-1af2d9b8-8459-43bd-ad9e-128e8285f4c6 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Received event network-vif-deleted-10901e7f-5971-4eb9-8a6d-509019ba3c79 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:48 user nova-compute[74721]: INFO nova.compute.manager [req-38c1ba21-fada-4f1e-92e1-9c10279fd401 req-1af2d9b8-8459-43bd-ad9e-128e8285f4c6 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Neutron deleted interface 10901e7f-5971-4eb9-8a6d-509019ba3c79; detaching it from the instance and deleting it from the info cache
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.network.neutron [req-38c1ba21-fada-4f1e-92e1-9c10279fd401 req-1af2d9b8-8459-43bd-ad9e-128e8285f4c6 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-38c1ba21-fada-4f1e-92e1-9c10279fd401 req-1af2d9b8-8459-43bd-ad9e-128e8285f4c6 service nova] [instance: 71d0fd0d-73ca-4921-9064-c9d70f98cc8f] Detach interface failed, port_id=10901e7f-5971-4eb9-8a6d-509019ba3c79, reason: Instance 71d0fd0d-73ca-4921-9064-c9d70f98cc8f could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:48 user nova-compute[74721]: INFO nova.compute.claims [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Claim successful on node user
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23832353936636666', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832353936636666', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.objects.instance [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:07:48 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:07:48 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:07:48 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:07:48 user nova-compute[74721]:   <serial>9345b923-ff59-4252-8d43-6df06775e0eb</serial>
Nov 02 23:07:48 user nova-compute[74721]: </disk>
Nov 02 23:07:48 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.478s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:48 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:e0:d6:46, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.policy [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee89915190bc4dcaafc152b0767d70a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc5e65b042947ed8f88d0a0722d2f78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Creating image(s)
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.207s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-52a37a5b-01e5-415e-9801-58005c033f7b tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.703s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.773s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.926s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:49 user nova-compute[74721]: INFO nova.compute.claims [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Claim successful on node user
Nov 02 23:07:49 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Deleted allocations for instance 71d0fd0d-73ca-4921-9064-c9d70f98cc8f
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d607ba98-c989-4198-bf7b-a0dc8b87f618 tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "71d0fd0d-73ca-4921-9064-c9d70f98cc8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.699s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.245s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk 1073741824" returned: 0 in 0.065s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Successfully created port: a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.011s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:50 user nova-compute[74721]: INFO nova.compute.claims [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Claim successful on node user
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Cannot resize image /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Ensure instance console log exists: /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.policy [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddb654019bab4504a67a9fe16c032fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa27a912c4b4bfa84f24b2105bbb1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Creating image(s)
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "/opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "/opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Successfully updated port: a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-changed-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Refreshing instance network info cache due to event network-changed-a9c2b78d-27f7-43b5-9a40-7330ef5cf205. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Refreshing network info cache for port a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.245s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk 1073741824" returned: 0 in 0.068s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Creating image(s)
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.193s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Successfully created port: 0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Cannot resize image /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Ensure instance console log exists: /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.policy [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee89915190bc4dcaafc152b0767d70a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc5e65b042947ed8f88d0a0722d2f78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk 1073741824" returned: 0 in 0.070s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b62c4ccd-8637-4c54-a7ce-de5e8b9b7a22 req-5af58e18-ff89-41f6-a097-cc5fef75de06 service nova] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.280s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Successfully updated port: 0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Cannot resize image /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Ensure instance console log exists: /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquired lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-changed-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Refreshing instance network info cache due to event network-changed-0ee17fe0-f1dc-4771-94eb-9380e4e7056c. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] Acquiring lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance network_info: |[{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start _get_guest_xml network_info=[{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Successfully created port: 92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2029541802',display_name='tempest-ServerRescueNegativeTestJSON-server-2029541802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2029541802',id=23,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-4vh1kk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:49Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=ed86a8bd-c846-431f-adf5-c990136d5e85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:52 user nova-compute[74721]:   <uuid>ed86a8bd-c846-431f-adf5-c990136d5e85</uuid>
Nov 02 23:07:52 user nova-compute[74721]:   <name>instance-00000017</name>
Nov 02 23:07:52 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:52 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:52 user nova-compute[74721]:   <metadata>
Nov 02 23:07:52 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:52 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2029541802</nova:name>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:52</nova:creationTime>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:52 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:52 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:07:52 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:07:52 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:52 user nova-compute[74721]:         <nova:port uuid="a9c2b78d-27f7-43b5-9a40-7330ef5cf205">
Nov 02 23:07:52 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:07:52 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:52 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:52 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:52 user nova-compute[74721]:   </metadata>
Nov 02 23:07:52 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:52 user nova-compute[74721]:     <system>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="serial">ed86a8bd-c846-431f-adf5-c990136d5e85</entry>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="uuid">ed86a8bd-c846-431f-adf5-c990136d5e85</entry>
Nov 02 23:07:52 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:52 user nova-compute[74721]:     </system>
Nov 02 23:07:52 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:52 user nova-compute[74721]:   <os>
Nov 02 23:07:52 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:52 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:52 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:52 user nova-compute[74721]:   </os>
Nov 02 23:07:52 user nova-compute[74721]:   <features>
Nov 02 23:07:52 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:52 user nova-compute[74721]:     <apic/>
Nov 02 23:07:52 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:52 user nova-compute[74721]:   </features>
Nov 02 23:07:52 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:52 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:52 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:52 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:52 user nova-compute[74721]:   </clock>
Nov 02 23:07:52 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:52 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:52 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:52 user nova-compute[74721]:   </cpu>
Nov 02 23:07:52 user nova-compute[74721]:   <devices>
Nov 02 23:07:52 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:07:52 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:07:52 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk"/>
Nov 02 23:07:52 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:52 user nova-compute[74721]:     </disk>
Nov 02 23:07:52 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:52 user nova-compute[74721]:       <mac address="fa:16:3e:8b:6f:d1"/>
Nov 02 23:07:52 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:52 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:52 user nova-compute[74721]:       <target dev="tapa9c2b78d-27"/>
Nov 02 23:07:52 user nova-compute[74721]:     </interface>
Nov 02 23:07:52 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:52 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/console.log" append="off"/>
Nov 02 23:07:52 user nova-compute[74721]:     </serial>
Nov 02 23:07:52 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:52 user nova-compute[74721]:     <video>
Nov 02 23:07:52 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:52 user nova-compute[74721]:     </video>
Nov 02 23:07:52 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:52 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:52 user nova-compute[74721]:     </rng>
Nov 02 23:07:52 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:52 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:52 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:52 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:52 user nova-compute[74721]:   </devices>
Nov 02 23:07:52 user nova-compute[74721]: </domain>
Nov 02 23:07:52 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2029541802',display_name='tempest-ServerRescueNegativeTestJSON-server-2029541802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2029541802',id=23,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-4vh1kk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:49Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=ed86a8bd-c846-431f-adf5-c990136d5e85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG os_vif [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8215723-922f-59f6-a491-e0d2c82d6702', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9c2b78d-27, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9c2b78d-27, col_values=(('qos', UUID('1153ab32-74e7-4aa2-993a-9c15eda008d3')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9c2b78d-27, col_values=(('external_ids', {'iface-id': 'a9c2b78d-27f7-43b5-9a40-7330ef5cf205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:6f:d1', 'vm-uuid': 'ed86a8bd-c846-431f-adf5-c990136d5e85'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:52 user nova-compute[74721]: INFO os_vif [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27')
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating instance_info_cache with network_info: [{"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Releasing lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Instance network_info: |[{"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] Acquired lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.network.neutron [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Refreshing network info cache for port 0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Start _get_guest_xml network_info=[{"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:8b:6f:d1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1085534064',display_name='tempest-TestServerVolumeAttachmentScenario-server-1085534064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1085534064',id=24,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJw7BfEt3QtMXa4fdStBIuQLENLBd85yaT/Rm0ZeUNRMWenWBvX469REuYfCMjHCSWRpAAmlfkbcHqqbKpBQAMFy2n0flYemt9FClhQi4yvc3t33SWlXeipmr3XNwyarw==',key_name='tempest-keypair-71191032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa27a912c4b4bfa84f24b2105bbb1ea',ramdisk_id='',reservation_id='r-pt08t1sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1063835074',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1063835074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb654019bab4504a67a9fe16c032fa5',uuid=3f4c55ff-6ab7-410d-b149-3c51c69c084f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converting VIF {"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:53 user nova-compute[74721]:   <uuid>3f4c55ff-6ab7-410d-b149-3c51c69c084f</uuid>
Nov 02 23:07:53 user nova-compute[74721]:   <name>instance-00000018</name>
Nov 02 23:07:53 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:53 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:53 user nova-compute[74721]:   <metadata>
Nov 02 23:07:53 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:53 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1085534064</nova:name>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:52</nova:creationTime>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:53 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:53 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:user uuid="ddb654019bab4504a67a9fe16c032fa5">tempest-TestServerVolumeAttachmentScenario-1063835074-project-member</nova:user>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:project uuid="8fa27a912c4b4bfa84f24b2105bbb1ea">tempest-TestServerVolumeAttachmentScenario-1063835074</nova:project>
Nov 02 23:07:53 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:07:53 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:53 user nova-compute[74721]:         <nova:port uuid="0ee17fe0-f1dc-4771-94eb-9380e4e7056c">
Nov 02 23:07:53 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 23:07:53 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:53 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:53 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:53 user nova-compute[74721]:   </metadata>
Nov 02 23:07:53 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:53 user nova-compute[74721]:     <system>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="serial">3f4c55ff-6ab7-410d-b149-3c51c69c084f</entry>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="uuid">3f4c55ff-6ab7-410d-b149-3c51c69c084f</entry>
Nov 02 23:07:53 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:53 user nova-compute[74721]:     </system>
Nov 02 23:07:53 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:53 user nova-compute[74721]:   <os>
Nov 02 23:07:53 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:53 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:53 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:53 user nova-compute[74721]:   </os>
Nov 02 23:07:53 user nova-compute[74721]:   <features>
Nov 02 23:07:53 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:53 user nova-compute[74721]:     <apic/>
Nov 02 23:07:53 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:53 user nova-compute[74721]:   </features>
Nov 02 23:07:53 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:53 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:53 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:53 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:53 user nova-compute[74721]:   </clock>
Nov 02 23:07:53 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:53 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:53 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:53 user nova-compute[74721]:   </cpu>
Nov 02 23:07:53 user nova-compute[74721]:   <devices>
Nov 02 23:07:53 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:07:53 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:07:53 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk"/>
Nov 02 23:07:53 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:53 user nova-compute[74721]:     </disk>
Nov 02 23:07:53 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:53 user nova-compute[74721]:       <mac address="fa:16:3e:b7:d3:45"/>
Nov 02 23:07:53 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:53 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:53 user nova-compute[74721]:       <target dev="tap0ee17fe0-f1"/>
Nov 02 23:07:53 user nova-compute[74721]:     </interface>
Nov 02 23:07:53 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:53 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/console.log" append="off"/>
Nov 02 23:07:53 user nova-compute[74721]:     </serial>
Nov 02 23:07:53 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:53 user nova-compute[74721]:     <video>
Nov 02 23:07:53 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:53 user nova-compute[74721]:     </video>
Nov 02 23:07:53 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:53 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:53 user nova-compute[74721]:     </rng>
Nov 02 23:07:53 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:53 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:53 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:53 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:53 user nova-compute[74721]:   </devices>
Nov 02 23:07:53 user nova-compute[74721]: </domain>
Nov 02 23:07:53 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1085534064',display_name='tempest-TestServerVolumeAttachmentScenario-server-1085534064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1085534064',id=24,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJw7BfEt3QtMXa4fdStBIuQLENLBd85yaT/Rm0ZeUNRMWenWBvX469REuYfCMjHCSWRpAAmlfkbcHqqbKpBQAMFy2n0flYemt9FClhQi4yvc3t33SWlXeipmr3XNwyarw==',key_name='tempest-keypair-71191032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa27a912c4b4bfa84f24b2105bbb1ea',ramdisk_id='',reservation_id='r-pt08t1sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1063835074',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1063835074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb654019bab4504a67a9fe16c032fa5',uuid=3f4c55ff-6ab7-410d-b149-3c51c69c084f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converting VIF {"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG os_vif [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7cebbc7-3094-525b-aaf8-1f981cefde28', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee17fe0-f1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee17fe0-f1, col_values=(('qos', UUID('9f235ffe-4849-4a53-b52d-6be6b0600101')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee17fe0-f1, col_values=(('external_ids', {'iface-id': '0ee17fe0-f1dc-4771-94eb-9380e4e7056c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d3:45', 'vm-uuid': '3f4c55ff-6ab7-410d-b149-3c51c69c084f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:53 user nova-compute[74721]: INFO os_vif [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1')
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] No VIF found with MAC fa:16:3e:b7:d3:45, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Successfully updated port: 92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-changed-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Refreshing instance network info cache due to event network-changed-92f24f89-d647-4d2b-a8fe-b057760bfef6. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updated VIF entry in instance network info cache for port 0ee17fe0-f1dc-4771-94eb-9380e4e7056c. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating instance_info_cache with network_info: [{"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3ca9e91e-39f9-4e54-98b7-30a086881604 req-47d4b1ff-8eeb-4a39-bdc5-9540c54a2083 service nova] Releasing lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance network_info: |[{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.network.neutron [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Refreshing network info cache for port 92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start _get_guest_xml network_info=[{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-580707213',display_name='tempest-ServerRescueNegativeTestJSON-server-580707213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-580707213',id=25,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-z56q9nhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:51Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=867bc1c7-5187-4d0e-949f-cd5c11c1159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:54 user nova-compute[74721]:   <uuid>867bc1c7-5187-4d0e-949f-cd5c11c1159e</uuid>
Nov 02 23:07:54 user nova-compute[74721]:   <name>instance-00000019</name>
Nov 02 23:07:54 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:54 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:54 user nova-compute[74721]:   <metadata>
Nov 02 23:07:54 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:54 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-580707213</nova:name>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:53</nova:creationTime>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:54 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:54 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:07:54 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:07:54 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:54 user nova-compute[74721]:         <nova:port uuid="92f24f89-d647-4d2b-a8fe-b057760bfef6">
Nov 02 23:07:54 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:07:54 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:54 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:54 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:54 user nova-compute[74721]:   </metadata>
Nov 02 23:07:54 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:54 user nova-compute[74721]:     <system>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="serial">867bc1c7-5187-4d0e-949f-cd5c11c1159e</entry>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="uuid">867bc1c7-5187-4d0e-949f-cd5c11c1159e</entry>
Nov 02 23:07:54 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:54 user nova-compute[74721]:     </system>
Nov 02 23:07:54 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:54 user nova-compute[74721]:   <os>
Nov 02 23:07:54 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:54 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:54 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:54 user nova-compute[74721]:   </os>
Nov 02 23:07:54 user nova-compute[74721]:   <features>
Nov 02 23:07:54 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:54 user nova-compute[74721]:     <apic/>
Nov 02 23:07:54 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:54 user nova-compute[74721]:   </features>
Nov 02 23:07:54 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:54 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:54 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:54 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:54 user nova-compute[74721]:   </clock>
Nov 02 23:07:54 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:54 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:54 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:54 user nova-compute[74721]:   </cpu>
Nov 02 23:07:54 user nova-compute[74721]:   <devices>
Nov 02 23:07:54 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:07:54 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:07:54 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk"/>
Nov 02 23:07:54 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:54 user nova-compute[74721]:     </disk>
Nov 02 23:07:54 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:54 user nova-compute[74721]:       <mac address="fa:16:3e:d0:29:54"/>
Nov 02 23:07:54 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:54 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:54 user nova-compute[74721]:       <target dev="tap92f24f89-d6"/>
Nov 02 23:07:54 user nova-compute[74721]:     </interface>
Nov 02 23:07:54 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:54 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/console.log" append="off"/>
Nov 02 23:07:54 user nova-compute[74721]:     </serial>
Nov 02 23:07:54 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:54 user nova-compute[74721]:     <video>
Nov 02 23:07:54 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:54 user nova-compute[74721]:     </video>
Nov 02 23:07:54 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:54 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:54 user nova-compute[74721]:     </rng>
Nov 02 23:07:54 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:54 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:54 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:54 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:54 user nova-compute[74721]:   </devices>
Nov 02 23:07:54 user nova-compute[74721]: </domain>
Nov 02 23:07:54 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-580707213',display_name='tempest-ServerRescueNegativeTestJSON-server-580707213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-580707213',id=25,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-z56q9nhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:51Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=867bc1c7-5187-4d0e-949f-cd5c11c1159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG os_vif [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '646436a9-6533-522f-a3bc-d5ffc9be194c', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92f24f89-d6, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92f24f89-d6, col_values=(('qos', UUID('b5d5505a-91cd-47c4-981f-3331fec3cdf4')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92f24f89-d6, col_values=(('external_ids', {'iface-id': '92f24f89-d647-4d2b-a8fe-b057760bfef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:29:54', 'vm-uuid': '867bc1c7-5187-4d0e-949f-cd5c11c1159e'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:54 user nova-compute[74721]: INFO os_vif [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6')
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:d0:29:54, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.neutron [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updated VIF entry in instance network info cache for port 92f24f89-d647-4d2b-a8fe-b057760bfef6. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG nova.network.neutron [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-45a10484-c562-44c8-a36a-f002ad97b878 req-59ca0b97-24dd-4a73-9305-0e8d1bc62ff9 service nova] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:55 user nova-compute[74721]: INFO nova.compute.claims [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Claim successful on node user
Nov 02 23:07:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.policy [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83010d67d3514cd69c99767c0b77fb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd99aa517e74a5aa15c46d174a025b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:07:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Creating image(s)
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:07:56 user nova-compute[74721]: INFO nova.compute.claims [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Claim successful on node user
Nov 02 23:07:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:56 user nova-compute[74721]: WARNING nova.compute.manager [req-4317fea6-bffa-468e-ade3-6cf2870d5c0e req-5c924741-f325-4f60-9799-407f78860475 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state building and task_state spawning.
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.246s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk 1073741824" returned: 0 in 0.063s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Cannot resize image /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Ensure instance console log exists: /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] No waiting events found dispatching network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:57 user nova-compute[74721]: WARNING nova.compute.manager [req-28d4184b-c7fa-4ddc-85b0-4c2ae75783c1 req-5d09e396-3383-4a7d-9646-a613cd947eb8 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received unexpected event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c for instance with vm_state building and task_state spawning.
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Successfully created port: 334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.047s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:07:57 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.policy [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d3fb4cd21c349a1b60f075ffa63f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9ed314de1541b6854e6158ee0816a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:07:57 user nova-compute[74721]: INFO nova.virt.block_device [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Booting with volume ba16bd44-d914-40b1-9af5-3c95daf76a44 at /dev/vda
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.utils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f1b368-3133-4d84-94ca-eb3d9d9565fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15db11b-7ba8-45eb-84ad-808b8aecb19f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4759415c-e78a-47b6-b36b-2f84ef27500d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b372ad-9292-40e5-ac41-f9acebc03e65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:07:57 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:07:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfdfffd-b7fa-420a-bc1f-5a99287db826]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG os_brick.utils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:07:57 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating existing volume attachment record: 20bb4a46-ad13-419c-9cf9-b0e7e07db36e {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Successfully updated port: 334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquired lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-changed-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Refreshing instance network info cache due to event network-changed-334801a8-f185-47f9-b73d-94e02612a7b5. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] Acquiring lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updating instance_info_cache with network_info: [{"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:59 user nova-compute[74721]: WARNING nova.compute.manager [req-deda3d97-b9f9-41b9-8257-49437502ac3c req-fc81605e-d97e-445c-8fc4-4ba28a69d08a service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state building and task_state spawning.
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Releasing lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Instance network_info: |[{"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] Acquired lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.neutron [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Refreshing network info cache for port 334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Start _get_guest_xml network_info=[{"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:07:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084033058',display_name='tempest-AttachVolumeNegativeTest-server-1084033058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084033058',id=26,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt6dxwDsyj6RDQQEWxuGeGzhcYwNgHNz+mRqaOMX2r6ldtv5POhtN2RnKzIl83EVZE7PMwGuWTpdQpAaA63P5eoHQ8ObK+tJ9RSOhBWwLOE88HhAJNeLydSKZFbnG2bRw==',key_name='tempest-keypair-518450589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-w0xszn8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=a6751b46-300d-4c30-9f69-ed57aabf1a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'pci_devices' on Instance uuid a6751b46-300d-4c30-9f69-ed57aabf1a98 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] No waiting events found dispatching network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:07:59 user nova-compute[74721]: WARNING nova.compute.manager [req-2d9e43b4-9322-40d9-8cb0-cf5d859b04d8 req-4bc5b493-0549-4508-aefb-9853f67a3d36 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received unexpected event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c for instance with vm_state building and task_state spawning.
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:07:59 user nova-compute[74721]:   <uuid>a6751b46-300d-4c30-9f69-ed57aabf1a98</uuid>
Nov 02 23:07:59 user nova-compute[74721]:   <name>instance-0000001a</name>
Nov 02 23:07:59 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:07:59 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:07:59 user nova-compute[74721]:   <metadata>
Nov 02 23:07:59 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:07:59 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1084033058</nova:name>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:07:59</nova:creationTime>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:07:59 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:07:59 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:owner>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:user uuid="83010d67d3514cd69c99767c0b77fb67">tempest-AttachVolumeNegativeTest-1503140472-project-member</nova:user>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:project uuid="0bd99aa517e74a5aa15c46d174a025b0">tempest-AttachVolumeNegativeTest-1503140472</nova:project>
Nov 02 23:07:59 user nova-compute[74721]:       </nova:owner>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:07:59 user nova-compute[74721]:       <nova:ports>
Nov 02 23:07:59 user nova-compute[74721]:         <nova:port uuid="334801a8-f185-47f9-b73d-94e02612a7b5">
Nov 02 23:07:59 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:07:59 user nova-compute[74721]:         </nova:port>
Nov 02 23:07:59 user nova-compute[74721]:       </nova:ports>
Nov 02 23:07:59 user nova-compute[74721]:     </nova:instance>
Nov 02 23:07:59 user nova-compute[74721]:   </metadata>
Nov 02 23:07:59 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:07:59 user nova-compute[74721]:     <system>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="serial">a6751b46-300d-4c30-9f69-ed57aabf1a98</entry>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="uuid">a6751b46-300d-4c30-9f69-ed57aabf1a98</entry>
Nov 02 23:07:59 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:07:59 user nova-compute[74721]:     </system>
Nov 02 23:07:59 user nova-compute[74721]:   </sysinfo>
Nov 02 23:07:59 user nova-compute[74721]:   <os>
Nov 02 23:07:59 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:07:59 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:07:59 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:07:59 user nova-compute[74721]:   </os>
Nov 02 23:07:59 user nova-compute[74721]:   <features>
Nov 02 23:07:59 user nova-compute[74721]:     <acpi/>
Nov 02 23:07:59 user nova-compute[74721]:     <apic/>
Nov 02 23:07:59 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:07:59 user nova-compute[74721]:   </features>
Nov 02 23:07:59 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:07:59 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:07:59 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:07:59 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:07:59 user nova-compute[74721]:   </clock>
Nov 02 23:07:59 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:07:59 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:07:59 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:07:59 user nova-compute[74721]:   </cpu>
Nov 02 23:07:59 user nova-compute[74721]:   <devices>
Nov 02 23:07:59 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:07:59 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:07:59 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk"/>
Nov 02 23:07:59 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:07:59 user nova-compute[74721]:     </disk>
Nov 02 23:07:59 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:07:59 user nova-compute[74721]:       <mac address="fa:16:3e:99:b0:3b"/>
Nov 02 23:07:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:59 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:07:59 user nova-compute[74721]:       <target dev="tap334801a8-f1"/>
Nov 02 23:07:59 user nova-compute[74721]:     </interface>
Nov 02 23:07:59 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:07:59 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/console.log" append="off"/>
Nov 02 23:07:59 user nova-compute[74721]:     </serial>
Nov 02 23:07:59 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:07:59 user nova-compute[74721]:     <video>
Nov 02 23:07:59 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:07:59 user nova-compute[74721]:     </video>
Nov 02 23:07:59 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:07:59 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:07:59 user nova-compute[74721]:     </rng>
Nov 02 23:07:59 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:07:59 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:07:59 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:07:59 user nova-compute[74721]:     </memballoon>
Nov 02 23:07:59 user nova-compute[74721]:   </devices>
Nov 02 23:07:59 user nova-compute[74721]: </domain>
Nov 02 23:07:59 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084033058',display_name='tempest-AttachVolumeNegativeTest-server-1084033058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084033058',id=26,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt6dxwDsyj6RDQQEWxuGeGzhcYwNgHNz+mRqaOMX2r6ldtv5POhtN2RnKzIl83EVZE7PMwGuWTpdQpAaA63P5eoHQ8ObK+tJ9RSOhBWwLOE88HhAJNeLydSKZFbnG2bRw==',key_name='tempest-keypair-518450589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-w0xszn8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=a6751b46-300d-4c30-9f69-ed57aabf1a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG os_vif [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1376b703-85f9-5082-8be3-6bbbe461e8a6', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Successfully created port: d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap334801a8-f1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap334801a8-f1, col_values=(('qos', UUID('227d8f2c-fe25-4ee6-b649-5b6870a6edd2')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap334801a8-f1, col_values=(('external_ids', {'iface-id': '334801a8-f185-47f9-b73d-94e02612a7b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:b0:3b', 'vm-uuid': 'a6751b46-300d-4c30-9f69-ed57aabf1a98'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:07:59 user nova-compute[74721]: INFO os_vif [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1')
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:07:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:99:b0:3b, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updated VIF entry in instance network info cache for port 334801a8-f185-47f9-b73d-94e02612a7b5. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updating instance_info_cache with network_info: [{"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c500fa8c-c895-44eb-bfc2-6244b0b4e843 req-8ba204d2-dbcc-484c-b822-7cd8e04a148a service nova] Releasing lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Successfully updated port: d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:08:00 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance spawned successfully.
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:00 user nova-compute[74721]: INFO nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Took 11.58 seconds to spawn the instance on the hypervisor.
Nov 02 23:08:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Instance spawned successfully.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.compute.manager [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Took 12.94 seconds to build instance.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f21536fb-aedd-40a0-b488-202d3313acbe tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.192s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:01 user nova-compute[74721]: WARNING nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state building and task_state spawning.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:01 user nova-compute[74721]: WARNING nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state building and task_state spawning.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-changed-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Refreshing instance network info cache due to event network-changed-d14b80b3-c95a-4f20-88e2-716939a87eab. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Took 10.81 seconds to spawn the instance on the hypervisor.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance spawned successfully.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.network.neutron [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance network_info: |[{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Refreshing network info cache for port d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.compute.manager [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Took 12.93 seconds to build instance.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68f90530-9109-4484-bc0d-70e1c7dcb4a2 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.208s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Took 10.33 seconds to spawn the instance on the hypervisor.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:01 user nova-compute[74721]: INFO nova.compute.manager [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Took 12.53 seconds to build instance.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] No waiting events found dispatching network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:01 user nova-compute[74721]: WARNING nova.compute.manager [req-dbeb5395-1fbc-4967-823f-6cd9f0349f6f req-f6436784-ba33-480b-9ab8-ef1640d66e42 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received unexpected event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 for instance with vm_state building and task_state spawning.
Nov 02 23:08:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0f1dc916-38e3-46af-ab84-7f566f4341ae tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updated VIF entry in instance network info cache for port d14b80b3-c95a-4f20-88e2-716939a87eab. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:08:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1df11d36-18ea-483c-85e1-fb9bcd0d75f1 req-904eeee0-cdde-4e44-9b68-eed396f9ca13 service nova] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] No waiting events found dispatching network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:03 user nova-compute[74721]: WARNING nova.compute.manager [req-d58cfce7-c3b7-425e-8e88-5144e6b1a9b4 req-ad0cff44-461d-42df-b7ec-04197519e8c6 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received unexpected event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 for instance with vm_state building and task_state spawning.
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:08:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Instance spawned successfully.
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:04 user nova-compute[74721]: INFO nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Took 8.05 seconds to spawn the instance on the hypervisor.
Nov 02 23:08:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:08:04 user nova-compute[74721]: INFO nova.compute.manager [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Took 9.02 seconds to build instance.
Nov 02 23:08:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-32f6c8e3-5581-431d-8f18-0d2c1f978951 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.150s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:29 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:08:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:08:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updating instance_info_cache with network_info: [{"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-848014b4-7b18-46ac-aa18-d85ad52c6eef" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:08:31 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:08:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Creating image(s)
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Ensure instance console log exists: /opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start _get_guest_xml network_info=[{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '20bb4a46-ad13-419c-9cf9-b0e7e07db36e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4043343b-caf6-4c8d-bdfb-cbed139e2ba6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba16bd44-d914-40b1-9af5-3c95daf76a44', 'serial': 'ba16bd44-d914-40b1-9af5-3c95daf76a44'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:08:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:08:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:08:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:08:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:08:33 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb80993-6ce3-4bc1-ae29-20df60351d1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:08:33 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae6d2db-cc2c-47f1-9de6-0d6a51347bd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44] added
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ba1ec-6a23-44c3-84fb-98a6f3dddc4d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65822f-303c-48ff-a174-76333779f2ee]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFefYmBy {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFefYmBy" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb056ce0-c83c-4b34-9fb8-0efcf1c93cb3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xFefYmBy'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e12b30-4a73-4d15-a822-9160873556a6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00a531-a277-457a-9810-3629c45e1bf7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[006aaa0e-d937-486d-a8fe-176a0fed83cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]
Nov 02 23:08:33 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60561e8-0fe2-4767-b7ce-03015ed0aad3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af6586-1556-4aa8-b11b-f0cd65e0f04c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:33 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:08:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdafda0e-8660-46cc-9ea6-132bff188afe]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26537346435326335', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537346435326335', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'pci_devices' on Instance uuid 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:08:34 user nova-compute[74721]:   <uuid>4043343b-caf6-4c8d-bdfb-cbed139e2ba6</uuid>
Nov 02 23:08:34 user nova-compute[74721]:   <name>instance-0000001b</name>
Nov 02 23:08:34 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:08:34 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:08:34 user nova-compute[74721]:   <metadata>
Nov 02 23:08:34 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:08:34 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:08:34 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherA-server-1046938844</nova:name>
Nov 02 23:08:34 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:08:33</nova:creationTime>
Nov 02 23:08:34 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:08:34 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:08:34 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:08:34 user nova-compute[74721]:       <nova:owner>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:user uuid="2d3fb4cd21c349a1b60f075ffa63f393">tempest-ServerActionsTestOtherA-756381715-project-member</nova:user>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:project uuid="8d9ed314de1541b6854e6158ee0816a0">tempest-ServerActionsTestOtherA-756381715</nova:project>
Nov 02 23:08:34 user nova-compute[74721]:       </nova:owner>
Nov 02 23:08:34 user nova-compute[74721]:       <nova:ports>
Nov 02 23:08:34 user nova-compute[74721]:         <nova:port uuid="d14b80b3-c95a-4f20-88e2-716939a87eab">
Nov 02 23:08:34 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:08:34 user nova-compute[74721]:         </nova:port>
Nov 02 23:08:34 user nova-compute[74721]:       </nova:ports>
Nov 02 23:08:34 user nova-compute[74721]:     </nova:instance>
Nov 02 23:08:34 user nova-compute[74721]:   </metadata>
Nov 02 23:08:34 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:08:34 user nova-compute[74721]:     <system>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="serial">4043343b-caf6-4c8d-bdfb-cbed139e2ba6</entry>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="uuid">4043343b-caf6-4c8d-bdfb-cbed139e2ba6</entry>
Nov 02 23:08:34 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:08:34 user nova-compute[74721]:     </system>
Nov 02 23:08:34 user nova-compute[74721]:   </sysinfo>
Nov 02 23:08:34 user nova-compute[74721]:   <os>
Nov 02 23:08:34 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:08:34 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:08:34 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:08:34 user nova-compute[74721]:   </os>
Nov 02 23:08:34 user nova-compute[74721]:   <features>
Nov 02 23:08:34 user nova-compute[74721]:     <acpi/>
Nov 02 23:08:34 user nova-compute[74721]:     <apic/>
Nov 02 23:08:34 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:08:34 user nova-compute[74721]:   </features>
Nov 02 23:08:34 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:08:34 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:08:34 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:08:34 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:08:34 user nova-compute[74721]:   </clock>
Nov 02 23:08:34 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:08:34 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:08:34 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:08:34 user nova-compute[74721]:   </cpu>
Nov 02 23:08:34 user nova-compute[74721]:   <devices>
Nov 02 23:08:34 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:08:34 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:08:34 user nova-compute[74721]:       <source dev="/dev/sdd"/>
Nov 02 23:08:34 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:08:34 user nova-compute[74721]:       <serial>ba16bd44-d914-40b1-9af5-3c95daf76a44</serial>
Nov 02 23:08:34 user nova-compute[74721]:     </disk>
Nov 02 23:08:34 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:08:34 user nova-compute[74721]:       <mac address="fa:16:3e:32:de:6e"/>
Nov 02 23:08:34 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:08:34 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:08:34 user nova-compute[74721]:       <target dev="tapd14b80b3-c9"/>
Nov 02 23:08:34 user nova-compute[74721]:     </interface>
Nov 02 23:08:34 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:08:34 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6/console.log" append="off"/>
Nov 02 23:08:34 user nova-compute[74721]:     </serial>
Nov 02 23:08:34 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:08:34 user nova-compute[74721]:     <video>
Nov 02 23:08:34 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:08:34 user nova-compute[74721]:     </video>
Nov 02 23:08:34 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:08:34 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:08:34 user nova-compute[74721]:     </rng>
Nov 02 23:08:34 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:08:34 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:08:34 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:08:34 user nova-compute[74721]:     </memballoon>
Nov 02 23:08:34 user nova-compute[74721]:   </devices>
Nov 02 23:08:34 user nova-compute[74721]: </domain>
Nov 02 23:08:34 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG os_vif [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbf7080a-9412-58e7-93de-3c6aa0444f39', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd14b80b3-c9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd14b80b3-c9, col_values=(('qos', UUID('d4b15b3c-ad3c-49f2-95e3-357966e858b9')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd14b80b3-c9, col_values=(('external_ids', {'iface-id': 'd14b80b3-c95a-4f20-88e2-716939a87eab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:de:6e', 'vm-uuid': '4043343b-caf6-4c8d-bdfb-cbed139e2ba6'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:34 user nova-compute[74721]: INFO os_vif [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9')
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:08:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:32:de:6e, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:08:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:36 user nova-compute[74721]: WARNING nova.compute.manager [req-2f21c575-ebdd-4f20-aaf0-2e4371c9e17f req-83026506-8923-4ed9-a3fe-0775576ac635 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state building and task_state spawning.
Nov 02 23:08:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:38 user nova-compute[74721]: WARNING nova.compute.manager [req-98dfa7e9-b4cb-47cd-b54c-1ffc45d06ccc req-8c6d91c1-4cdd-4cbf-96e1-9b601b1e9d9d service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state building and task_state spawning.
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:08:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance spawned successfully.
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:08:38 user nova-compute[74721]: INFO nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 02 23:08:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:08:38 user nova-compute[74721]: INFO nova.compute.manager [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Took 42.63 seconds to build instance.
Nov 02 23:08:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-301c252b-5e68-4a94-8d62-45e078b0a15c tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.825s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:08:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:08:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:08:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:08:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7071MB free_disk=25.374736785888672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance f645085b-cb51-4134-ad75-b635ff687ed2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ec739fdb-b759-473d-8091-7421604b8a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 81b931c4-19b3-4a02-b002-bd3791508385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance a6751b46-300d-4c30-9f69-ed57aabf1a98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:08:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:08:45 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:08:45 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:08:45 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:08:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-changed-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Refreshing instance network info cache due to event network-changed-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] Acquiring lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] Acquired lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Refreshing network info cache for port f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updated VIF entry in instance network info cache for port f0d8ff07-87d6-4051-9f49-e4d2fecf1f61. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating instance_info_cache with network_info: [{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c30d2f0-5bc4-478f-872b-1bb7cf360c33 req-13b01b28-afef-4ff0-93ae-4e2079cc30fe service nova] Releasing lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:52 user nova-compute[74721]: INFO nova.compute.manager [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Terminating instance
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-33645529-ebd9-4642-b4b0-2569c9f71398 req-7944afe9-bbe3-4846-8cb2-3dfa73aecbbc service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-unplugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:08:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Instance destroyed successfully.
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lazy-loading 'resources' on Instance uuid f645085b-cb51-4134-ad75-b635ff687ed2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-342025052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2043823634',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYL7jeMjm0xD+0W8rJvbobrbasWfTzjq54OB7UjTNbY6qomxgVu632Sg3HGin/x1dLqywRPbB7FytJr5odl//QKcIAFC5Hn0YVELpoyLBTGI+6bTbFLEF9X16F5AnwpwA==',key_name='tempest-keypair-1595033802',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a31f16591d4189bd728b4d69175796',ramdisk_id='',reservation_id='r-r08xv7wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-540561610',owner_user_name='tempest-ServerActionsV293TestJSON-540561610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2979ae9ac194589921de6ba94e576d3',uuid=f645085b-cb51-4134-ad75-b635ff687ed2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converting VIF {"id": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "address": "fa:16:3e:ac:f0:b6", "network": {"id": "a89b55fe-9167-4bce-822e-74a8b78ea305", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-512454801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a31f16591d4189bd728b4d69175796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f07a5be-f2", "ovs_interfaceid": "5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG os_vif [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f07a5be-f2, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b81ed01-c174-4221-994c-861c240c9cd4) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:52 user nova-compute[74721]: INFO os_vif [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:f0:b6,bridge_name='br-int',has_traffic_filtering=True,id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f,network=Network(a89b55fe-9167-4bce-822e-74a8b78ea305),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f07a5be-f2')
Nov 02 23:08:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaUThtMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:08:52 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:08:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:08:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e58a08-de9c-4f16-9614-d3ec9ebf5c98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:08:53 user nova-compute[74721]: No targets found.
Nov 02 23:08:53 user nova-compute[74721]: iSNS:
Nov 02 23:08:53 user nova-compute[74721]: No targets found.
Nov 02 23:08:53 user nova-compute[74721]: STATIC:
Nov 02 23:08:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b
Nov 02 23:08:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:08:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:08:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:08:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:08:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:08:53 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:08:53 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:08:53 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:08:53 user nova-compute[74721]: FIRMWARE:
Nov 02 23:08:53 user nova-compute[74721]: No targets found.
Nov 02 23:08:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:08:53 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:08:53 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[740804e6-e42d-47e6-8ea4-6c8a4cdf4d76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24946753-77ec-416d-a714-77846a197972]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:53 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:53 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:08:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b (non-flash)
Nov 02 23:08:53 user nova-compute[74721]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:08:53 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:08:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2466d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d134ea8-bc1d-4ee9-8b25-9a5170906956]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b1571-865e-486d-a752-cad9ecbfec57]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5aeb0b-7f25-49cb-b6f1-6dbb38781116]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a5fe2-b55c-496f-9ba3-1d4292fbcad0]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd89f3a03-ea818d680b5deedb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d89f3a03', '/dev/disk/by-id/scsi-26561383138643638') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9c3371-e38c-4510-a3db-a98ce5a88cfc]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e43515-d4b3-4955-b574-956eeb9c54ec]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35b094-6dc5-408e-9acf-a9555909691a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260]
Nov 02 23:08:53 user nova-compute[74721]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b, portal: 172.16.0.220,3260] successful.
Nov 02 23:08:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a8516e-8593-40fb-a8cf-8d35b64ed56b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab87c89-4ae6-48d9-b3d2-60c5fdfe8f7d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] <== disconnect_volume: return (435ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:08:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deleting instance files /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2_del
Nov 02 23:08:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deletion of /opt/stack/data/nova/instances/f645085b-cb51-4134-ad75-b635ff687ed2_del complete
Nov 02 23:08:53 user nova-compute[74721]: INFO nova.compute.manager [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:53 user nova-compute[74721]: INFO nova.compute.manager [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attaching volume cf3de818-85e6-46d4-85c8-3a62cab4f77e to /dev/vdb
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.utils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05ae03-2ed6-4290-883d-5a8621053dcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d921e6-ed06-4fda-92b2-398f4288e2f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879cff3-ea86-4f18-a377-4731eabc532a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ee2a6-7a39-40a4-b1ec-a3f6b4ae0124]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:08:53 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:08:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba8e05-2ced-436e-a87a-0228189f8815]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG os_brick.utils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:08:53 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating existing volume attachment record: 0ac5bf26-953f-4f05-bc93-19c6b689f7ee {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] Acquiring lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] Lock "f645085b-cb51-4134-ad75-b635ff687ed2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] No waiting events found dispatching network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:08:54 user nova-compute[74721]: WARNING nova.compute.manager [req-5d4f476f-5844-4bd9-b8d3-b215a793072b req-38edb6f4-4d5b-4957-a478-a176c68c615f service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received unexpected event network-vif-plugged-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f for instance with vm_state active and task_state deleting.
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-eb1bba79-1a18-45a4-ae37-ecf35e69c922 req-4ddfda7d-1a51-4d56-807b-0986794fe59b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Received event network-vif-deleted-5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:54 user nova-compute[74721]: INFO nova.compute.manager [req-eb1bba79-1a18-45a4-ae37-ecf35e69c922 req-4ddfda7d-1a51-4d56-807b-0986794fe59b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Neutron deleted interface 5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f; detaching it from the instance and deleting it from the info cache
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.network.neutron [req-eb1bba79-1a18-45a4-ae37-ecf35e69c922 req-4ddfda7d-1a51-4d56-807b-0986794fe59b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:54 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Took 1.18 seconds to deallocate network for instance.
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-eb1bba79-1a18-45a4-ae37-ecf35e69c922 req-4ddfda7d-1a51-4d56-807b-0986794fe59b service nova] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Detach interface failed, port_id=5f07a5be-f2f9-4e14-8f1b-db8cccb02f6f, reason: Instance f645085b-cb51-4134-ad75-b635ff687ed2 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-changed-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Refreshing instance network info cache due to event network-changed-d90c976e-9859-4d95-9a13-6dcb5d46724f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] Acquiring lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] Acquired lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:08:54 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Refreshing network info cache for port d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG nova.objects.instance [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:08:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Ignoring supplied device name: /dev/vdb
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:55 user nova-compute[74721]: INFO nova.compute.manager [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Attaching volume a2ab9321-5df0-4d84-94b6-499702ba7ec9 to /dev/vdb
Nov 02 23:08:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updated VIF entry in instance network info cache for port d90c976e-9859-4d95-9a13-6dcb5d46724f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updating instance_info_cache with network_info: [{"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4ad4ecc-741d-41d1-908b-f488bbfd0972 req-99d0d4a7-ded0-4d9e-8095-431be48bd050 service nova] Releasing lock "refresh_cache-81b931c4-19b3-4a02-b002-bd3791508385" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.utils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7199039-22fc-4829-9d30-7e28439c01a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de4afc5-2fdc-4bbc-866a-cd7fd13c1a8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c691fa6-7ca7-47e9-be1a-202a43a69f2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69fc8f-e38c-4c51-b744-750c38c9d721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:08:55 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a76756-b66c-4cf0-abf0-ae435cc8a9c0]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG os_brick.utils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updating existing volume attachment record: 570ba258-e0a7-40c5-85c2-ac78f5928775 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:08:55 user nova-compute[74721]: INFO nova.compute.manager [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Took 1.03 seconds to detach 1 volumes for instance.
Nov 02 23:08:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] [instance: f645085b-cb51-4134-ad75-b635ff687ed2] Deleting volume: e3a8516e-8593-40fb-a8cf-8d35b64ed56b {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:08:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:08:56 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:08:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:08:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:56 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Deleted allocations for instance f645085b-cb51-4134-ad75-b635ff687ed2
Nov 02 23:08:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0aa55fb-b9dd-424e-b01b-7573fdcbd99a tempest-ServerActionsV293TestJSON-540561610 tempest-ServerActionsV293TestJSON-540561610-project-member] Lock "f645085b-cb51-4134-ad75-b635ff687ed2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.433s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:08:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgFABDGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:16 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:16 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:16 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de6bf63-f68d-4392-96df-4b9b703799fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:09:16 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[837d69d7-29c5-4fab-a2ee-107bc4489024]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e] added
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da10a6-00df-4e63-a459-f086ac92cfef]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8b452-b089-4c58-9e36-7bd656a332f3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgFABDGK {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgFABDGK" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a85da4-adca-4873-96e0-92d72a39b3dc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgFABDGK'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4097af71-d478-466f-8d37-85458fc461ac]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[647dea02-2108-4b1c-9ec0-a977034ff62b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[278564e5-7c7a-4c98-a5f4-f0a371ee7812]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260]
Nov 02 23:09:16 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260] successful.
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cac6ec-abcb-4752-9557-6e176ae726f1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc9cbe0-86b5-4107-84b3-5c7f174ffe85]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:16 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[43038edf-f74b-493e-853d-4cf64bcab004]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgFABDGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23338386466306237', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338386466306237', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:09:17 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:09:17 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:09:17 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:09:17 user nova-compute[74721]:   <serial>cf3de818-85e6-46d4-85c8-3a62cab4f77e</serial>
Nov 02 23:09:17 user nova-compute[74721]: </disk>
Nov 02 23:09:17 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMAcRYPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:17 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:17 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:17 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c70d41-6990-4770-94c2-e7027261e061]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:09:17 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc137ea-0c12-4c90-a383-2ff8bd38ef24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:17 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9] added
Nov 02 23:09:17 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No VIF found with MAC fa:16:3e:c8:6f:19, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e162125-7021-4830-bbed-3af2b7e1ffcb]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b88e5e-c94c-4694-a0cb-0645bb0101fd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMAcRYPB {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMAcRYPB" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52c205-a9a3-4a55-ab35-b45983336beb]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kMAcRYPB'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4455666a-b4fc-461c-8eb6-5365d976ed75]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa8cc54-2014-4400-b8ee-297540ffed7a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-796fde3f-be6d-46c3-8e97-2eb8fec8c240 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.464s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db8b6b-7ec4-4bda-8a0b-baca0d867d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260]
Nov 02 23:09:18 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260] successful.
Nov 02 23:09:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7ff0fa-f6a5-4fa1-912c-5e9412762f7d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[35324c8c-ef0d-44b0-b184-f5038885db99]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:18 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8642ad-97cf-49ad-8521-d42e723dea25]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:09:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMAcRYPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26235353636373236', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235353636373236', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.objects.instance [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:09:19 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:09:19 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:09:19 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:09:19 user nova-compute[74721]:   <serial>a2ab9321-5df0-4d84-94b6-499702ba7ec9</serial>
Nov 02 23:09:19 user nova-compute[74721]: </disk>
Nov 02 23:09:19 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No VIF found with MAC fa:16:3e:e5:a9:75, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:09:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-63a44ff1-7f8c-460d-9244-c5749f452e4c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.719s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:25 user nova-compute[74721]: INFO nova.compute.manager [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attaching volume 9efcba1e-78ad-4980-99a0-5bd8e3c39c6f to /dev/vdc
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.utils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3b639-651d-48e6-a21e-c9a2edaf37ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2afb3-ca51-48d5-9c2f-6e3965b4f010]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201ea4f-1a6c-46ee-bae4-e51b5e52f01b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad990c-ecda-4ad8-bb5f-f314a3d769d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:09:25 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:09:25 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d9914c-e425-46c3-b26f-dee47362d450]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG os_brick.utils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating existing volume attachment record: b6119152-0ac4-4fdd-9af4-4017d3431cbd {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:09:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:36 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating instance_info_cache with network_info: [{"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:09:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:38 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:38 user nova-compute[74721]: INFO nova.compute.manager [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Rescuing
Nov 02 23:09:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:38 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-changed-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Refreshing instance network info cache due to event network-changed-0ee17fe0-f1dc-4771-94eb-9380e4e7056c. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] Acquiring lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] Acquired lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG nova.network.neutron [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Refreshing network info cache for port 0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:40 user nova-compute[74721]: WARNING nova.compute.manager [req-a6ade2a0-dd83-41eb-a0b2-37b7319d6966 req-806e580c-1029-4ea6-8ec9-858021c2be4d service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state active and task_state rescuing.
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updated VIF entry in instance network info cache for port 0ee17fe0-f1dc-4771-94eb-9380e4e7056c. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating instance_info_cache with network_info: [{"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e43f434c-1c29-49b3-aa6b-9b3b1a4645e3 req-0c02cc30-24b7-4b12-b2b3-7abed286b1c5 service nova] Releasing lock "refresh_cache-3f4c55ff-6ab7-410d-b149-3c51c69c084f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance destroyed successfully.
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Attempting rescue
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Creating image(s)
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'flavor' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue" returned: 0 in 0.072s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'migration_context' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.compute.manager [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Attaching volume 1071000f-f1db-412a-acab-2c0dfdefd0b4 to /dev/vdb
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<867bc1c7-5187-4d0e-949f-cd5c11c1159e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start _get_guest_xml network_info=[{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:d0:29:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<867bc1c7-5187-4d0e-949f-cd5c11c1159e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'numa_topology' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<867bc1c7-5187-4d0e-949f-cd5c11c1159e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:09:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG os_brick.utils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<867bc1c7-5187-4d0e-949f-cd5c11c1159e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-580707213',display_name='tempest-ServerRescueNegativeTestJSON-server-580707213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-580707213',id=25,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-z56q9nhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:08:02Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=867bc1c7-5187-4d0e-949f-cd5c11c1159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:d0:29:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:d0:29:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db98ff-8907-4f29-b45d-824f8b594378]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<867bc1c7-5187-4d0e-949f-cd5c11c1159e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:09:40 user nova-compute[74721]:   <uuid>867bc1c7-5187-4d0e-949f-cd5c11c1159e</uuid>
Nov 02 23:09:40 user nova-compute[74721]:   <name>instance-00000019</name>
Nov 02 23:09:40 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:09:40 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:09:40 user nova-compute[74721]:   <metadata>
Nov 02 23:09:40 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:09:40 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-580707213</nova:name>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:09:40</nova:creationTime>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:09:40 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:09:40 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:owner>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:09:40 user nova-compute[74721]:       </nova:owner>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:09:40 user nova-compute[74721]:       <nova:ports>
Nov 02 23:09:40 user nova-compute[74721]:         <nova:port uuid="92f24f89-d647-4d2b-a8fe-b057760bfef6">
Nov 02 23:09:40 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:09:40 user nova-compute[74721]:         </nova:port>
Nov 02 23:09:40 user nova-compute[74721]:       </nova:ports>
Nov 02 23:09:40 user nova-compute[74721]:     </nova:instance>
Nov 02 23:09:40 user nova-compute[74721]:   </metadata>
Nov 02 23:09:40 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:09:40 user nova-compute[74721]:     <system>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="serial">867bc1c7-5187-4d0e-949f-cd5c11c1159e</entry>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="uuid">867bc1c7-5187-4d0e-949f-cd5c11c1159e</entry>
Nov 02 23:09:40 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:09:40 user nova-compute[74721]:     </system>
Nov 02 23:09:40 user nova-compute[74721]:   </sysinfo>
Nov 02 23:09:40 user nova-compute[74721]:   <os>
Nov 02 23:09:40 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:09:40 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:09:40 user nova-compute[74721]:   </os>
Nov 02 23:09:40 user nova-compute[74721]:   <features>
Nov 02 23:09:40 user nova-compute[74721]:     <acpi/>
Nov 02 23:09:40 user nova-compute[74721]:     <apic/>
Nov 02 23:09:40 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:09:40 user nova-compute[74721]:   </features>
Nov 02 23:09:40 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:09:40 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:09:40 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:09:40 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:09:40 user nova-compute[74721]:   </clock>
Nov 02 23:09:40 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:09:40 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:09:40 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:09:40 user nova-compute[74721]:   </cpu>
Nov 02 23:09:40 user nova-compute[74721]:   <devices>
Nov 02 23:09:40 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:09:40 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:09:40 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue"/>
Nov 02 23:09:40 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:09:40 user nova-compute[74721]:     </disk>
Nov 02 23:09:40 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:09:40 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:09:40 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk"/>
Nov 02 23:09:40 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:09:40 user nova-compute[74721]:     </disk>
Nov 02 23:09:40 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:09:40 user nova-compute[74721]:       <mac address="fa:16:3e:d0:29:54"/>
Nov 02 23:09:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:09:40 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:09:40 user nova-compute[74721]:       <target dev="tap92f24f89-d6"/>
Nov 02 23:09:40 user nova-compute[74721]:     </interface>
Nov 02 23:09:40 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:09:40 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/console.log" append="off"/>
Nov 02 23:09:40 user nova-compute[74721]:     </serial>
Nov 02 23:09:40 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:09:40 user nova-compute[74721]:     <video>
Nov 02 23:09:40 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:09:40 user nova-compute[74721]:     </video>
Nov 02 23:09:40 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:09:40 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:09:40 user nova-compute[74721]:     </rng>
Nov 02 23:09:40 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:09:40 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:09:40 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:09:40 user nova-compute[74721]:     </memballoon>
Nov 02 23:09:40 user nova-compute[74721]:   </devices>
Nov 02 23:09:40 user nova-compute[74721]: </domain>
Nov 02 23:09:40 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance destroyed successfully.
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a1ab10-48d8-49d4-be58-beca1e946b98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:09:40 user nova-compute[74721]: INFO nova.compute.claims [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Claim successful on node user
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ad5f3-da8c-485f-a985-18cf546b8683]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28b2a3-053c-43f4-845c-070a5595b5c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:09:41 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bae94-2b3c-4082-8bf5-813ee77f2472]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG os_brick.utils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating existing volume attachment record: 6739b9e4-21ef-4a44-8308-f4c9ab2105f5 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:d0:29:54, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:09:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.policy [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bafa1c7ca10f41098e7638458b5b0cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77852adbb3ec456d857643fc25923ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:09:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Creating image(s)
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "/opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "/opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:42 user nova-compute[74721]: WARNING nova.compute.manager [req-e352fe94-8c5c-4252-a0f9-053d03d951ec req-ee7b60b0-3ee0-447c-95cd-39e4ef291a24 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state active and task_state rescuing.
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk 1073741824" returned: 0 in 0.068s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.244s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Cannot resize image /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Ensure instance console log exists: /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Successfully created port: 40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Successfully updated port: 40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquired lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:44 user nova-compute[74721]: WARNING nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state active and task_state rescuing.
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:44 user nova-compute[74721]: WARNING nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state active and task_state rescuing.
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-changed-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Refreshing instance network info cache due to event network-changed-40f79c3b-70d5-4319-a9de-8f49f58f4945. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Acquiring lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Releasing lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Instance network_info: |[{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Acquired lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.neutron [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Refreshing network info cache for port 40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Start _get_guest_xml network_info=[{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:09:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079536467',display_name='tempest-SnapshotDataIntegrityTests-server-2079536467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079536467',id=28,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeeXeTA3EVzKdnun45EihBhROiZLVfkQ/M2BakGTj1R9YLBqWjB7Lm+36SJf3KYmnv5Ebc+zx/kY3Y8+YKNAmr+F4IB+OvQnmHIEJFoAajGYtSrvvEAn3d0TL801di46g==',key_name='tempest-keypair-236405300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77852adbb3ec456d857643fc25923ade',ramdisk_id='',reservation_id='r-wgzxdrqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1233588154',owner_user_name='tempest-SnapshotDataIntegrityTests-1233588154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa1c7ca10f41098e7638458b5b0cfc',uuid=ad44e9ee-70f5-4a28-b05d-b2de910419e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converting VIF {"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'pci_devices' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:09:44 user nova-compute[74721]:   <uuid>ad44e9ee-70f5-4a28-b05d-b2de910419e2</uuid>
Nov 02 23:09:44 user nova-compute[74721]:   <name>instance-0000001c</name>
Nov 02 23:09:44 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:09:44 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:09:44 user nova-compute[74721]:   <metadata>
Nov 02 23:09:44 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:09:44 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2079536467</nova:name>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:09:44</nova:creationTime>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:09:44 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:09:44 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:owner>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:user uuid="bafa1c7ca10f41098e7638458b5b0cfc">tempest-SnapshotDataIntegrityTests-1233588154-project-member</nova:user>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:project uuid="77852adbb3ec456d857643fc25923ade">tempest-SnapshotDataIntegrityTests-1233588154</nova:project>
Nov 02 23:09:44 user nova-compute[74721]:       </nova:owner>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:09:44 user nova-compute[74721]:       <nova:ports>
Nov 02 23:09:44 user nova-compute[74721]:         <nova:port uuid="40f79c3b-70d5-4319-a9de-8f49f58f4945">
Nov 02 23:09:44 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:09:44 user nova-compute[74721]:         </nova:port>
Nov 02 23:09:44 user nova-compute[74721]:       </nova:ports>
Nov 02 23:09:44 user nova-compute[74721]:     </nova:instance>
Nov 02 23:09:44 user nova-compute[74721]:   </metadata>
Nov 02 23:09:44 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:09:44 user nova-compute[74721]:     <system>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="serial">ad44e9ee-70f5-4a28-b05d-b2de910419e2</entry>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="uuid">ad44e9ee-70f5-4a28-b05d-b2de910419e2</entry>
Nov 02 23:09:44 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:09:44 user nova-compute[74721]:     </system>
Nov 02 23:09:44 user nova-compute[74721]:   </sysinfo>
Nov 02 23:09:44 user nova-compute[74721]:   <os>
Nov 02 23:09:44 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:09:44 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:09:44 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:09:44 user nova-compute[74721]:   </os>
Nov 02 23:09:44 user nova-compute[74721]:   <features>
Nov 02 23:09:44 user nova-compute[74721]:     <acpi/>
Nov 02 23:09:44 user nova-compute[74721]:     <apic/>
Nov 02 23:09:44 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:09:44 user nova-compute[74721]:   </features>
Nov 02 23:09:44 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:09:44 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:09:44 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:09:44 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:09:44 user nova-compute[74721]:   </clock>
Nov 02 23:09:44 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:09:44 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:09:44 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:09:44 user nova-compute[74721]:   </cpu>
Nov 02 23:09:44 user nova-compute[74721]:   <devices>
Nov 02 23:09:44 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:09:44 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:09:44 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk"/>
Nov 02 23:09:44 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:09:44 user nova-compute[74721]:     </disk>
Nov 02 23:09:44 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:09:44 user nova-compute[74721]:       <mac address="fa:16:3e:ac:49:ba"/>
Nov 02 23:09:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:09:44 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:09:44 user nova-compute[74721]:       <target dev="tap40f79c3b-70"/>
Nov 02 23:09:44 user nova-compute[74721]:     </interface>
Nov 02 23:09:44 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:09:44 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/console.log" append="off"/>
Nov 02 23:09:44 user nova-compute[74721]:     </serial>
Nov 02 23:09:44 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:09:44 user nova-compute[74721]:     <video>
Nov 02 23:09:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:09:44 user nova-compute[74721]:     </video>
Nov 02 23:09:44 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:09:44 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:09:44 user nova-compute[74721]:     </rng>
Nov 02 23:09:44 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:09:44 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:09:44 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:09:44 user nova-compute[74721]:     </memballoon>
Nov 02 23:09:44 user nova-compute[74721]:   </devices>
Nov 02 23:09:44 user nova-compute[74721]: </domain>
Nov 02 23:09:44 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079536467',display_name='tempest-SnapshotDataIntegrityTests-server-2079536467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079536467',id=28,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeeXeTA3EVzKdnun45EihBhROiZLVfkQ/M2BakGTj1R9YLBqWjB7Lm+36SJf3KYmnv5Ebc+zx/kY3Y8+YKNAmr+F4IB+OvQnmHIEJFoAajGYtSrvvEAn3d0TL801di46g==',key_name='tempest-keypair-236405300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77852adbb3ec456d857643fc25923ade',ramdisk_id='',reservation_id='r-wgzxdrqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1233588154',owner_user_name='tempest-SnapshotDataIntegrityTests-1233588154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa1c7ca10f41098e7638458b5b0cfc',uuid=ad44e9ee-70f5-4a28-b05d-b2de910419e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converting VIF {"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG os_vif [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5167293e-bf56-5687-b525-5066eb7b56ba', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40f79c3b-70, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40f79c3b-70, col_values=(('qos', UUID('20d9a68c-da20-4134-bef4-e159c1d554c3')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40f79c3b-70, col_values=(('external_ids', {'iface-id': '40f79c3b-70d5-4319-a9de-8f49f58f4945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:49:ba', 'vm-uuid': 'ad44e9ee-70f5-4a28-b05d-b2de910419e2'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:44 user nova-compute[74721]: INFO os_vif [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70')
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No VIF found with MAC fa:16:3e:ac:49:ba, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3d2c287f-362f-4f3d-b6b2-561854ec70b0 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updated VIF entry in instance network info cache for port 40f79c3b-70d5-4319-a9de-8f49f58f4945. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1a1de5c0-28b2-4253-9ee2-7bb7c229e89f req-5729eeda-2f88-4dab-b548-311aad46c0ec service nova] Releasing lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] No waiting events found dispatching network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:46 user nova-compute[74721]: WARNING nova.compute.manager [req-11f56cad-b8d0-4c71-b225-e9ca43b9a069 req-1ca6784c-fc02-4693-9b0f-31432ad8ceb9 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received unexpected event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 for instance with vm_state building and task_state spawning.
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-changed-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Refreshing instance network info cache due to event network-changed-334801a8-f185-47f9-b73d-94e02612a7b5. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] Acquiring lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] Acquired lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Refreshing network info cache for port 334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] No waiting events found dispatching network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:49 user nova-compute[74721]: WARNING nova.compute.manager [req-301fb0fc-03ce-4218-ab28-e7a22634715a req-5bd6e7d9-eec5-4933-8270-6f625cd9abc2 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received unexpected event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 for instance with vm_state building and task_state spawning.
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:09:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.35953140258789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Instance spawned successfully.
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:49 user nova-compute[74721]: INFO nova.compute.manager [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Terminating instance
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing instance network info cache due to event network-changed-923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Refreshing network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:09:49 user nova-compute[74721]: INFO nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Took 8.06 seconds to spawn the instance on the hypervisor.
Nov 02 23:09:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ec739fdb-b759-473d-8091-7421604b8a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 81b931c4-19b3-4a02-b002-bd3791508385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance a6751b46-300d-4c30-9f69-ed57aabf1a98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:09:50 user nova-compute[74721]: INFO nova.compute.manager [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Took 9.23 seconds to build instance.
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a17efd1a-c982-4e43-87b7-e1785c75c241 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.404s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updated VIF entry in instance network info cache for port 334801a8-f185-47f9-b73d-94e02612a7b5. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updating instance_info_cache with network_info: [{"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9e9cf97d-5be8-44d5-81e4-2f532559291f req-cd7f230f-11ad-4d09-b152-f9223dddeb6d service nova] Releasing lock "refresh_cache-a6751b46-300d-4c30-9f69-ed57aabf1a98" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Instance destroyed successfully.
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'resources' on Instance uuid a6751b46-300d-4c30-9f69-ed57aabf1a98 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084033058',display_name='tempest-AttachVolumeNegativeTest-server-1084033058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084033058',id=26,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt6dxwDsyj6RDQQEWxuGeGzhcYwNgHNz+mRqaOMX2r6ldtv5POhtN2RnKzIl83EVZE7PMwGuWTpdQpAaA63P5eoHQ8ObK+tJ9RSOhBWwLOE88HhAJNeLydSKZFbnG2bRw==',key_name='tempest-keypair-518450589',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-w0xszn8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=a6751b46-300d-4c30-9f69-ed57aabf1a98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "334801a8-f185-47f9-b73d-94e02612a7b5", "address": "fa:16:3e:99:b0:3b", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap334801a8-f1", "ovs_interfaceid": "334801a8-f185-47f9-b73d-94e02612a7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG os_vif [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap334801a8-f1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=227d8f2c-fe25-4ee6-b649-5b6870a6edd2) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:09:50 user nova-compute[74721]: INFO os_vif [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=334801a8-f185-47f9-b73d-94e02612a7b5,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap334801a8-f1')
Nov 02 23:09:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Deleting instance files /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98_del
Nov 02 23:09:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Deletion of /opt/stack/data/nova/instances/a6751b46-300d-4c30-9f69-ed57aabf1a98_del complete
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated VIF entry in instance network info cache for port 923ab59f-9276-44a6-88c0-f7388ba29d12. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.078s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-changed-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Refreshing instance network info cache due to event network-changed-d14b80b3-c95a-4f20-88e2-716939a87eab. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Refreshing network info cache for port d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:09:50 user nova-compute[74721]: INFO nova.compute.manager [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 02 23:09:50 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:09:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updated VIF entry in instance network info cache for port d14b80b3-c95a-4f20-88e2-716939a87eab. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aba6e6f6-7902-4eca-81c3-30ab91feac90 req-b7c4ad1e-c87d-4c90-b3fa-528d07b0f7ba service nova] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShQiGser', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:51 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:51 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:51 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:09:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Stashing vm_state: active {{(pid=74721) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb0eb6-1a5b-4c35-92e0-6a3658d44b76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:09:51 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3e2b2-1de1-4b9b-8611-3c052645752c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f] added
Nov 02 23:09:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae8cd3-afa9-419c-950f-23981107702c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df6ff7b-cd62-4610-b2c3-bf96168ae37a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShQiGser {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShQiGser" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235f559-008e-49b9-bde2-a3b8af56f1bf]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShQiGser'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b03394-3250-4fff-ae9f-cb3589d8da82]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc12a01-bd7d-4582-9218-6bdeb2bfe581]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:51 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:51 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc37d1-2826-45e0-ae08-81cddcf6bbf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:52 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Took 1.23 seconds to deallocate network for instance.
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-417ec041-1828-448a-9c43-f2eb28f30182 req-c8884f18-323d-4acc-889b-4b7496440109 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-deleted-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:52 user nova-compute[74721]: INFO nova.compute.manager [req-417ec041-1828-448a-9c43-f2eb28f30182 req-c8884f18-323d-4acc-889b-4b7496440109 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Neutron deleted interface 334801a8-f185-47f9-b73d-94e02612a7b5; detaching it from the instance and deleting it from the info cache
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.network.neutron [req-417ec041-1828-448a-9c43-f2eb28f30182 req-c8884f18-323d-4acc-889b-4b7496440109 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260]
Nov 02 23:09:52 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260] successful.
Nov 02 23:09:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:09:52 user nova-compute[74721]: INFO nova.compute.claims [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Claim successful on node user
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-unplugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] No waiting events found dispatching network-vif-unplugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-unplugged-334801a8-f185-47f9-b73d-94e02612a7b5 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Acquiring lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] No waiting events found dispatching network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:52 user nova-compute[74721]: WARNING nova.compute.manager [req-67b78c3f-6455-4765-8ee1-2be205f9ad73 req-4612bde8-6ea0-4b08-8251-f414d4a24a11 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Received unexpected event network-vif-plugged-334801a8-f185-47f9-b73d-94e02612a7b5 for instance with vm_state active and task_state deleting.
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c35716-f22d-4b4d-ad50-f31b89fb008f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-417ec041-1828-448a-9c43-f2eb28f30182 req-c8884f18-323d-4acc-889b-4b7496440109 service nova] [instance: a6751b46-300d-4c30-9f69-ed57aabf1a98] Detach interface failed, port_id=334801a8-f185-47f9-b73d-94e02612a7b5, reason: Instance a6751b46-300d-4c30-9f69-ed57aabf1a98 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:09:52 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating resource usage from migration 424c04b0-9f5b-4f46-9410-49fdb8eedb3e
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ebc37b-5f92-4559-b23b-32ed79e65170]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:09:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:52 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:09:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f31df-a5d6-4fda-84dc-a47ac35e4c32]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.787s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:52 user nova-compute[74721]: INFO nova.compute.manager [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Migrating
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.560s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:09:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShQiGser', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23865623933366134', 'path': '/dev/sdf'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865623933366134', 'path': '/dev/sdf'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:09:53 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:09:53 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:09:53 user nova-compute[74721]:   <target dev="vdc" bus="virtio"/>
Nov 02 23:09:53 user nova-compute[74721]:   <serial>9efcba1e-78ad-4980-99a0-5bd8e3c39c6f</serial>
Nov 02 23:09:53 user nova-compute[74721]: </disk>
Nov 02 23:09:53 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:53 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Deleted allocations for instance a6751b46-300d-4c30-9f69-ed57aabf1a98
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e094e9e1-0913-4787-9207-4a2f54266230 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "a6751b46-300d-4c30-9f69-ed57aabf1a98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.856s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Starting migrate_disk_and_power_off {{(pid=74721) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:09:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] No VIF found with MAC fa:16:3e:c8:6f:19, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b0af74ba-6fb8-4946-a8bf-5617d92ec8ef tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.826s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance destroyed successfully.
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd14b80b3-c9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4b15b3c-ad3c-49f2-95e3-357966e858b9) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:54 user nova-compute[74721]: INFO os_vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9')
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:09:54 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282831f-5d5a-43ea-9213-ea1c2b641e78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:09:54 user nova-compute[74721]: No targets found.
Nov 02 23:09:54 user nova-compute[74721]: iSNS:
Nov 02 23:09:54 user nova-compute[74721]: No targets found.
Nov 02 23:09:54 user nova-compute[74721]: STATIC:
Nov 02 23:09:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:09:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:09:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:09:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e
Nov 02 23:09:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:09:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:09:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:09:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:09:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:09:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:09:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:09:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:09:54 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f
Nov 02 23:09:54 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:09:54 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:09:54 user nova-compute[74721]: FIRMWARE:
Nov 02 23:09:54 user nova-compute[74721]: No targets found.
Nov 02 23:09:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:09:54 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:09:54 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a4035-3bc7-4c61-855f-f4411fdd907a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[442aecf6-f5c2-46c2-87b1-d91326cc64b3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:09:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:09:54 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:09:54 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:54 user nova-compute[74721]: WARNING nova.compute.manager [req-a5c73477-ea96-486c-9679-5c4e7614fde5 req-2d35fcd8-ff97-4c2b-9615-7733011893ff service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state active and task_state resize_migrating.
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e39e96-865a-455c-81d4-138f06dfb73d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920714f-3cf8-43c6-a9d5-c46e0942f914]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[46749cd3-8c09-48ae-ac41-0f679c86be00]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.356s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6cefbe-b51a-43c8-8f30-b970d123b611]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db74af6-ce6b-466c-8d9e-9808ea606019]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d3a3ee-f41d-4061-a553-1482bb138d18]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]
Nov 02 23:09:55 user nova-compute[74721]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.
Nov 02 23:09:55 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[932f5769-cd4d-4d0a-805b-bb1920a32d64]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.843s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== disconnect_volume: return (845ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:55 user nova-compute[74721]: INFO nova.compute.manager [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Detaching volume cf3de818-85e6-46d4-85c8-3a62cab4f77e
Nov 02 23:09:55 user nova-compute[74721]: INFO nova.virt.block_device [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attempting to driver detach volume cf3de818-85e6-46d4-85c8-3a62cab4f77e from mountpoint /dev/vdb
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Attempting to detach device vdb from instance ec739fdb-b759-473d-8091-7421604b8a50 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:09:55 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:09:55 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:09:55 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:09:55 user nova-compute[74721]:   <serial>cf3de818-85e6-46d4-85c8-3a62cab4f77e</serial>
Nov 02 23:09:55 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:09:55 user nova-compute[74721]: </disk>
Nov 02 23:09:55 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:09:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdb from instance ec739fdb-b759-473d-8091-7421604b8a50 from the persistent domain config.
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec739fdb-b759-473d-8091-7421604b8a50 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:09:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:09:55 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:09:55 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:09:55 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:09:55 user nova-compute[74721]:   <serial>cf3de818-85e6-46d4-85c8-3a62cab4f77e</serial>
Nov 02 23:09:55 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:09:55 user nova-compute[74721]: </disk>
Nov 02 23:09:55 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:09:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:09:56 user nova-compute[74721]: WARNING nova.compute.manager [req-473a5be3-28b4-4e57-afba-7c7ea400bc06 req-509248d5-42ba-41f8-a891-ce39f101741c service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state active and task_state resize_migrating.
Nov 02 23:09:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Port d14b80b3-c95a-4f20-88e2-716939a87eab binding to destination host user is already ACTIVE {{(pid=74721) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.utils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c4668-5f4d-48a8-8f60-a7c63cdc66b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec430699-4ba7-4738-b851-b5afcec736f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c4b6ce-955c-4bd2-87b0-3c8bb1e72e49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f54c6-bbf1-432c-be63-70d6f7f1a299]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:10:06 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:10:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4f4cd-df17-4c10-abc7-8e6af86fd635]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:10:06 user nova-compute[74721]: DEBUG os_brick.utils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnTlJKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:07 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00aea0f-4376-4f11-9bce-de5490547918]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:10:07 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2646ff-444c-4fd7-a506-ce473b7de1d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4] added
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[707aef63-e01d-4c96-b1d0-42f45d59ec19]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6380e163-3a8c-4d10-9b95-ecd17108ca4d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnTlJKkB {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnTlJKkB" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd0e62-8858-47b0-868f-b84945e89158]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnTlJKkB'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b2c1d-eeb1-42da-bab9-939019fa0b20]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b3630-459c-4aea-99f7-cb429da48550]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9f96e-d442-45e1-a032-7f20781f2c07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260]
Nov 02 23:10:07 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260] successful.
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189129b-4c52-4dff-b4c8-8161ced55f3a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82ee7c-95d1-4808-acc0-0607915efeb4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:07 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a05abd-226e-4dbf-af1b-7dc82c842e46]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:10:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnTlJKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:10:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23735633032626333', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735633032626333', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:10:08 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'flavor' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:10:08 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:08 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:10:08 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:10:08 user nova-compute[74721]:   <serial>1071000f-f1db-412a-acab-2c0dfdefd0b4</serial>
Nov 02 23:10:08 user nova-compute[74721]: </disk>
Nov 02 23:10:08 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:10:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:10:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:10:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] No VIF found with MAC fa:16:3e:b7:d3:45, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:10:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c97ee876-18ad-4369-b2da-246971c43fee tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.776s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'flavor' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:14 user nova-compute[74721]: INFO nova.compute.manager [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Attaching volume 3a9f4bbd-bfed-4526-83db-1ba9383e6bfc to /dev/vdc
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.utils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c22b382-2570-4a10-a3dd-a22efd47630f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9945f82-aca7-4ead-b6f9-5287ff891045]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d67ba9-cfdb-4bc1-8f98-199884118bb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0295e50c-6ccf-439d-90cd-618914a532a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:10:14 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:10:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0bb711-417a-4f58-a356-5e2ef8a27718]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG os_brick.utils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating existing volume attachment record: 90fba25a-40a9-4a59-8d78-68f74c48e440 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:10:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:16 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec739fdb-b759-473d-8091-7421604b8a50 is timed out.
Nov 02 23:10:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdb from instance ec739fdb-b759-473d-8091-7421604b8a50 from the live domain config.
Nov 02 23:10:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgFABDGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:16 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d5c379-f8df-46d5-889a-124622cf8d57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:10:16 user nova-compute[74721]: No targets found.
Nov 02 23:10:16 user nova-compute[74721]: iSNS:
Nov 02 23:10:16 user nova-compute[74721]: No targets found.
Nov 02 23:10:16 user nova-compute[74721]: STATIC:
Nov 02 23:10:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:10:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:10:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e
Nov 02 23:10:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:10:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f
Nov 02 23:10:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:16 user nova-compute[74721]: FIRMWARE:
Nov 02 23:10:16 user nova-compute[74721]: No targets found.
Nov 02 23:10:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:10:16 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:10:16 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f84f3b8-9e38-410a-a461-2f940d8fb070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[89526153-20de-4fb5-8a9b-59e59339f0fd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:16 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf47c845e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5f05d-0ba7-4a00-85e0-d40fa797f5fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3597929-fe4c-4f37-92ee-04b4fa78c5d2]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72db882-35df-49dd-840b-7a17eee3572d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d040e458-da83-4a46-9a92-7f8ecb127f53]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b9c0a9-8860-452f-8d71-737ecd69b222]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929fd0f-10fc-4740-b1e5-09930f2b83ba]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260]
Nov 02 23:10:16 user nova-compute[74721]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e, portal: 172.16.0.220,3260] successful.
Nov 02 23:10:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf3de818-85e6-46d4-85c8-3a62cab4f77e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189767c-9937-4ca9-85ee-0a736392fc4d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== disconnect_volume: return (318ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.volume.cinder [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Update attachment failed for attachment 90fba25a-40a9-4a59-8d78-68f74c48e440. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Failed to attach 3a9f4bbd-bfed-4526-83db-1ba9383e6bfc at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Traceback (most recent call last):
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     self._do_attach(context, instance, volume, volume_api,
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     self._volume_attach(context, volume, connector, instance,
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     connection_info = volume_api.attachment_update(
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     res = method(self, ctx, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     return method.func(obj, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     resp = self._update('/attachments/%s' % id, body)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     return self.request(url, method, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f]     raise exceptions.from_response(resp, body)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480)
Nov 02 23:10:17 user nova-compute[74721]: ERROR nova.compute.manager [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] 
Nov 02 23:10:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 3.478s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server [None req-fed11f2b-3ea8-4adc-a22d-3a0e93157290 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5f99d1dc-0a8d-4f28-af1f-a3d08b3b0480)
Nov 02 23:10:17 user nova-compute[74721]: ERROR oslo_messaging.rpc.server 
Nov 02 23:10:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9cc901e1-17f3-43cf-9ecf-253af2ba63c4 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.262s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:19 user nova-compute[74721]: INFO nova.compute.manager [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Detaching volume 9efcba1e-78ad-4980-99a0-5bd8e3c39c6f
Nov 02 23:10:19 user nova-compute[74721]: INFO nova.virt.block_device [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Attempting to driver detach volume 9efcba1e-78ad-4980-99a0-5bd8e3c39c6f from mountpoint /dev/vdc
Nov 02 23:10:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Attempting to detach device vdc from instance ec739fdb-b759-473d-8091-7421604b8a50 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:10:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:10:19 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:19 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:10:19 user nova-compute[74721]:   <target dev="vdc" bus="virtio"/>
Nov 02 23:10:19 user nova-compute[74721]:   <serial>9efcba1e-78ad-4980-99a0-5bd8e3c39c6f</serial>
Nov 02 23:10:19 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 23:10:19 user nova-compute[74721]: </disk>
Nov 02 23:10:19 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:10:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdc from instance ec739fdb-b759-473d-8091-7421604b8a50 from the persistent domain config.
Nov 02 23:10:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ec739fdb-b759-473d-8091-7421604b8a50 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:10:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:10:19 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:19 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:10:19 user nova-compute[74721]:   <target dev="vdc" bus="virtio"/>
Nov 02 23:10:19 user nova-compute[74721]:   <serial>9efcba1e-78ad-4980-99a0-5bd8e3c39c6f</serial>
Nov 02 23:10:19 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 23:10:19 user nova-compute[74721]: </disk>
Nov 02 23:10:19 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:10:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:10:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Starting finish_migration {{(pid=74721) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:10:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Creating image(s)
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Ensure instance console log exists: /opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start _get_guest_xml network_info=[{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '9bd63eb7-e3ee-4897-9267-13a1e1621732', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4043343b-caf6-4c8d-bdfb-cbed139e2ba6', 'attached_at': '2023-11-02T23:10:30.000000', 'detached_at': '', 'volume_id': 'ba16bd44-d914-40b1-9af5-3c95daf76a44', 'serial': 'ba16bd44-d914-40b1-9af5-3c95daf76a44'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:10:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:30 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:30 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:30 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78009a-30c4-42bd-ad81-03284c03a7ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:10:30 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09fdafd-552d-4264-a7a5-bbbdc0df1356]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44] added
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc2bd45-1130-4dc9-97a2-304cca552d84]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3bf1f9-2a1f-49a7-be38-c0f0feede7dd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFefYmBy {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFefYmBy" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb1c48-a7d1-4874-a9c8-057b007d7624]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xFefYmBy'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d87ccc-a798-48d3-87f6-4fcd6c70661b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a355c3cd-c81d-48ad-94ff-bef4f244bb64]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe109893-5097-4094-8689-28c17c5fb7b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]
Nov 02 23:10:30 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92621516-2090-4f3d-8e7d-b27931b35dd0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927956a-4a35-4c4d-9d48-47c521ba842a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:10:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:10:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:31 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873b063-da46-4468-b6fe-783926809877]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:31 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:10:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26537346435326335', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537346435326335', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:10:32 user nova-compute[74721]:   <uuid>4043343b-caf6-4c8d-bdfb-cbed139e2ba6</uuid>
Nov 02 23:10:32 user nova-compute[74721]:   <name>instance-0000001b</name>
Nov 02 23:10:32 user nova-compute[74721]:   <memory>2097152</memory>
Nov 02 23:10:32 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:10:32 user nova-compute[74721]:   <metadata>
Nov 02 23:10:32 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:10:32 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:10:32 user nova-compute[74721]:       <nova:name>tempest-ServerActionsTestOtherA-server-1046938844</nova:name>
Nov 02 23:10:32 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:10:30</nova:creationTime>
Nov 02 23:10:32 user nova-compute[74721]:       <nova:flavor name="m1.small">
Nov 02 23:10:32 user nova-compute[74721]:         <nova:memory>2048</nova:memory>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:disk>20</nova:disk>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:10:32 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:10:32 user nova-compute[74721]:       <nova:owner>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:user uuid="2d3fb4cd21c349a1b60f075ffa63f393">tempest-ServerActionsTestOtherA-756381715-project-member</nova:user>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:project uuid="8d9ed314de1541b6854e6158ee0816a0">tempest-ServerActionsTestOtherA-756381715</nova:project>
Nov 02 23:10:32 user nova-compute[74721]:       </nova:owner>
Nov 02 23:10:32 user nova-compute[74721]:       <nova:ports>
Nov 02 23:10:32 user nova-compute[74721]:         <nova:port uuid="d14b80b3-c95a-4f20-88e2-716939a87eab">
Nov 02 23:10:32 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:10:32 user nova-compute[74721]:         </nova:port>
Nov 02 23:10:32 user nova-compute[74721]:       </nova:ports>
Nov 02 23:10:32 user nova-compute[74721]:     </nova:instance>
Nov 02 23:10:32 user nova-compute[74721]:   </metadata>
Nov 02 23:10:32 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:10:32 user nova-compute[74721]:     <system>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="serial">4043343b-caf6-4c8d-bdfb-cbed139e2ba6</entry>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="uuid">4043343b-caf6-4c8d-bdfb-cbed139e2ba6</entry>
Nov 02 23:10:32 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:10:32 user nova-compute[74721]:     </system>
Nov 02 23:10:32 user nova-compute[74721]:   </sysinfo>
Nov 02 23:10:32 user nova-compute[74721]:   <os>
Nov 02 23:10:32 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:10:32 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:10:32 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:10:32 user nova-compute[74721]:   </os>
Nov 02 23:10:32 user nova-compute[74721]:   <features>
Nov 02 23:10:32 user nova-compute[74721]:     <acpi/>
Nov 02 23:10:32 user nova-compute[74721]:     <apic/>
Nov 02 23:10:32 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:10:32 user nova-compute[74721]:   </features>
Nov 02 23:10:32 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:10:32 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:10:32 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:10:32 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:10:32 user nova-compute[74721]:   </clock>
Nov 02 23:10:32 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:10:32 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:10:32 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:10:32 user nova-compute[74721]:   </cpu>
Nov 02 23:10:32 user nova-compute[74721]:   <devices>
Nov 02 23:10:32 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:10:32 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:32 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:10:32 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:10:32 user nova-compute[74721]:       <serial>ba16bd44-d914-40b1-9af5-3c95daf76a44</serial>
Nov 02 23:10:32 user nova-compute[74721]:     </disk>
Nov 02 23:10:32 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:10:32 user nova-compute[74721]:       <mac address="fa:16:3e:32:de:6e"/>
Nov 02 23:10:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:10:32 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:10:32 user nova-compute[74721]:       <target dev="tapd14b80b3-c9"/>
Nov 02 23:10:32 user nova-compute[74721]:     </interface>
Nov 02 23:10:32 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:10:32 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6/console.log" append="off"/>
Nov 02 23:10:32 user nova-compute[74721]:     </serial>
Nov 02 23:10:32 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:10:32 user nova-compute[74721]:     <video>
Nov 02 23:10:32 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:10:32 user nova-compute[74721]:     </video>
Nov 02 23:10:32 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:10:32 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:10:32 user nova-compute[74721]:     </rng>
Nov 02 23:10:32 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:10:32 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:10:32 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:10:32 user nova-compute[74721]:     </memballoon>
Nov 02 23:10:32 user nova-compute[74721]:   </devices>
Nov 02 23:10:32 user nova-compute[74721]: </domain>
Nov 02 23:10:32 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-821384671-network", "vif_mac": "fa:16:3e:32:de:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG os_vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbf7080a-9412-58e7-93de-3c6aa0444f39', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd14b80b3-c9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd14b80b3-c9, col_values=(('qos', UUID('4bfeb603-96b1-45ce-8bf2-598bd6653fb5')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd14b80b3-c9, col_values=(('external_ids', {'iface-id': 'd14b80b3-c95a-4f20-88e2-716939a87eab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:de:6e', 'vm-uuid': '4043343b-caf6-4c8d-bdfb-cbed139e2ba6'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:32 user nova-compute[74721]: INFO os_vif [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9')
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:10:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] No VIF found with MAC fa:16:3e:32:de:6e, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:33 user nova-compute[74721]: WARNING nova.compute.manager [req-88361dae-ea93-443c-a6a8-e2d260048998 req-9eebbd9f-d84f-4425-bce3-2e9c46d69aa8 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state active and task_state resize_finish.
Nov 02 23:10:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:10:35 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance running successfully.
Nov 02 23:10:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Failed to set time: agent not configured {{(pid=74721) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bf75a674-b323-4195-896c-28821e41d208 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] finish_migration finished successfully. {{(pid=74721) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:35 user nova-compute[74721]: WARNING nova.compute.manager [req-9059d1bf-778c-4613-8c22-ec56ff5135da req-2de1e695-c001-44bf-bd5c-76796bad11ca service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state active and task_state resize_finish.
Nov 02 23:10:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ec739fdb-b759-473d-8091-7421604b8a50 is timed out.
Nov 02 23:10:40 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully detached device vdc from instance ec739fdb-b759-473d-8091-7421604b8a50 from the live domain config.
Nov 02 23:10:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShQiGser', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:10:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cbe72c-a886-4292-a466-7c093b191dd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:10:40 user nova-compute[74721]: No targets found.
Nov 02 23:10:40 user nova-compute[74721]: iSNS:
Nov 02 23:10:40 user nova-compute[74721]: No targets found.
Nov 02 23:10:40 user nova-compute[74721]: STATIC:
Nov 02 23:10:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:10:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:10:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:10:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:10:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:40 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f
Nov 02 23:10:40 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:10:40 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:10:40 user nova-compute[74721]: FIRMWARE:
Nov 02 23:10:40 user nova-compute[74721]: No targets found.
Nov 02 23:10:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:10:40 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:10:40 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a48231-5ad9-4419-952a-cb7e1ec10c5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecb690-3a15-4c95-868d-d7b26c4fd8e4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:10:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24733010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f'): ({'sdf'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Removing single pathed devices sdf {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d792b1-b31c-4c70-a8e3-a990676392cc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad065a31-2eb8-438b-87c1-f874db50b51d]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Flushing IO for device /dev/sdf {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd2cda7-0926-4e23-abcf-da9c87c8d01f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29015b2c-c2f6-424f-890b-6ddb8c17339a]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[689db057-20dc-4369-8ab6-81e365ee43e1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d61bdf2-4733-4461-961a-22ec72f72932]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260]
Nov 02 23:10:40 user nova-compute[74721]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f, portal: 172.16.0.220,3260] successful.
Nov 02 23:10:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcba1e-78ad-4980-99a0-5bd8e3c39c6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4e458-f57a-4cbe-bb75-57e508944bd8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] <== disconnect_volume: return (389ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:10:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'flavor' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-33334457-c342-4afa-998a-44d9b941cca9 tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.185s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating instance_info_cache with network_info: [{"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ec739fdb-b759-473d-8091-7421604b8a50" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:42 user nova-compute[74721]: INFO nova.compute.manager [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Detaching volume 9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:10:42 user nova-compute[74721]: INFO nova.virt.block_device [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Attempting to driver detach volume 9345b923-ff59-4252-8d43-6df06775e0eb from mountpoint /dev/vdb
Nov 02 23:10:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Attempting to detach device vdb from instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:10:42 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:42 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:10:42 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:10:42 user nova-compute[74721]:   <serial>9345b923-ff59-4252-8d43-6df06775e0eb</serial>
Nov 02 23:10:42 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:10:42 user nova-compute[74721]: </disk>
Nov 02 23:10:42 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:10:42 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d from the persistent domain config.
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:10:42 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:10:42 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:10:42 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:10:42 user nova-compute[74721]:   <serial>9345b923-ff59-4252-8d43-6df06775e0eb</serial>
Nov 02 23:10:42 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:10:42 user nova-compute[74721]: </disk>
Nov 02 23:10:42 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:10:43 user nova-compute[74721]: INFO nova.compute.claims [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Claim successful on node user
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:43 user nova-compute[74721]: INFO nova.compute.manager [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Terminating instance
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-unplugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] No waiting events found dispatching network-vif-unplugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-84be2acd-2ab1-4977-8ea6-7bfcccc9e4b8 req-ee07c707-5981-43b9-89cc-c5ebb48fa047 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-unplugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:43 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.028s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Instance destroyed successfully.
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lazy-loading 'resources' on Instance uuid ec739fdb-b759-473d-8091-7421604b8a50 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118640126',display_name='tempest-AttachVolumeTestJSON-server-2118640126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118640126',id=21,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtfRffVls0PcAydumm1YRg2xkK+1fMqVCgmqPsNoyYT+0hH8rj+jFHXVhVxRstTE0fyODJInyV8RdIfSjjG9aLQ1tDDNHMVgxFONyIw256OllvrKf4WJ3HgTc5dVt/9kg==',key_name='tempest-keypair-629746875',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:07:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bca4498dfb724e13ba1086d4e687d1ef',ramdisk_id='',reservation_id='r-qvnkg1bl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1894655503',owner_user_name='tempest-AttachVolumeTestJSON-1894655503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce9460acd644a25a9c32ade02941243',uuid=ec739fdb-b759-473d-8091-7421604b8a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converting VIF {"id": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "address": "fa:16:3e:c8:6f:19", "network": {"id": "16e2f92c-abbc-466e-a158-e216ab083780", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-146787578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bca4498dfb724e13ba1086d4e687d1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8ff07-87", "ovs_interfaceid": "f0d8ff07-87d6-4051-9f49-e4d2fecf1f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG os_vif [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0d8ff07-87, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67e94184-f452-4803-9545-7b86e5ac3bff) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:44 user nova-compute[74721]: INFO os_vif [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:6f:19,bridge_name='br-int',has_traffic_filtering=True,id=f0d8ff07-87d6-4051-9f49-e4d2fecf1f61,network=Network(16e2f92c-abbc-466e-a158-e216ab083780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8ff07-87')
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Deleting instance files /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50_del
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Deletion of /opt/stack/data/nova/instances/ec739fdb-b759-473d-8091-7421604b8a50_del complete
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.compute.manager [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.policy [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08b189befc4d4ee5b97979dbe65f3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcc705b0884843930cd1a0b5403cd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:10:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Creating image(s)
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "/opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "/opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "/opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.233s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.273s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk 1073741824" returned: 0 in 0.059s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.234s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'ec739fdb-b759-473d-8091-7421604b8a50' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ec739fdb-b759-473d-8091-7421604b8a50' (instance-00000015)
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Successfully created port: c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Cannot resize image /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Ensure instance console log exists: /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:10:45 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Took 1.35 seconds to deallocate network for instance.
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] Acquiring lock "ec739fdb-b759-473d-8091-7421604b8a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] Lock "ec739fdb-b759-473d-8091-7421604b8a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] No waiting events found dispatching network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:45 user nova-compute[74721]: WARNING nova.compute.manager [req-f4559eb0-3a56-4ee8-ae34-de769cce2c53 req-095ae3d5-4912-44fb-8cf9-491c53617427 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received unexpected event network-vif-plugged-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 for instance with vm_state active and task_state deleting.
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-b460d6f9-2d2e-4595-9d35-eaafde6831e4 req-f1d51f90-3a2c-4c79-b5e8-d35f11445ba4 service nova] [instance: ec739fdb-b759-473d-8091-7421604b8a50] Received event network-vif-deleted-f0d8ff07-87d6-4051-9f49-e4d2fecf1f61 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:10:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Successfully updated port: c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquired lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-changed-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Refreshing instance network info cache due to event network-changed-c5613433-1700-4dc8-8536-284843531360. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] Acquiring lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:10:46 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Deleted allocations for instance ec739fdb-b759-473d-8091-7421604b8a50
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4addb75d-8681-4fcd-a36e-0ad178c0295e tempest-AttachVolumeTestJSON-1894655503 tempest-AttachVolumeTestJSON-1894655503-project-member] Lock "ec739fdb-b759-473d-8091-7421604b8a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Updating instance_info_cache with network_info: [{"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Releasing lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Instance network_info: |[{"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] Acquired lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Refreshing network info cache for port c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Start _get_guest_xml network_info=[{"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:10:46 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:46 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318346580',display_name='tempest-VolumesNegativeTest-instance-318346580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318346580',id=29,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ddcc705b0884843930cd1a0b5403cd3',ramdisk_id='',reservation_id='r-wk0hei03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-130535392',owner_user_name='tempest-VolumesNegativeTest-130535392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:10:44Z,user_data=None,user_id='08b189befc4d4ee5b97979dbe65f3069',uuid=7440a338-7e3e-4160-908c-bc1bbe462d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converting VIF {"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lazy-loading 'pci_devices' on Instance uuid 7440a338-7e3e-4160-908c-bc1bbe462d11 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:10:47 user nova-compute[74721]:   <uuid>7440a338-7e3e-4160-908c-bc1bbe462d11</uuid>
Nov 02 23:10:47 user nova-compute[74721]:   <name>instance-0000001d</name>
Nov 02 23:10:47 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:10:47 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:10:47 user nova-compute[74721]:   <metadata>
Nov 02 23:10:47 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:10:47 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:name>tempest-VolumesNegativeTest-instance-318346580</nova:name>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:10:46</nova:creationTime>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:10:47 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:10:47 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:owner>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:user uuid="08b189befc4d4ee5b97979dbe65f3069">tempest-VolumesNegativeTest-130535392-project-member</nova:user>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:project uuid="1ddcc705b0884843930cd1a0b5403cd3">tempest-VolumesNegativeTest-130535392</nova:project>
Nov 02 23:10:47 user nova-compute[74721]:       </nova:owner>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:10:47 user nova-compute[74721]:       <nova:ports>
Nov 02 23:10:47 user nova-compute[74721]:         <nova:port uuid="c5613433-1700-4dc8-8536-284843531360">
Nov 02 23:10:47 user nova-compute[74721]:           <nova:ip type="fixed" address="192.168.233.74" ipVersion="4"/>
Nov 02 23:10:47 user nova-compute[74721]:         </nova:port>
Nov 02 23:10:47 user nova-compute[74721]:       </nova:ports>
Nov 02 23:10:47 user nova-compute[74721]:     </nova:instance>
Nov 02 23:10:47 user nova-compute[74721]:   </metadata>
Nov 02 23:10:47 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:10:47 user nova-compute[74721]:     <system>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="serial">7440a338-7e3e-4160-908c-bc1bbe462d11</entry>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="uuid">7440a338-7e3e-4160-908c-bc1bbe462d11</entry>
Nov 02 23:10:47 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:10:47 user nova-compute[74721]:     </system>
Nov 02 23:10:47 user nova-compute[74721]:   </sysinfo>
Nov 02 23:10:47 user nova-compute[74721]:   <os>
Nov 02 23:10:47 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:10:47 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:10:47 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:10:47 user nova-compute[74721]:   </os>
Nov 02 23:10:47 user nova-compute[74721]:   <features>
Nov 02 23:10:47 user nova-compute[74721]:     <acpi/>
Nov 02 23:10:47 user nova-compute[74721]:     <apic/>
Nov 02 23:10:47 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:10:47 user nova-compute[74721]:   </features>
Nov 02 23:10:47 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:10:47 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:10:47 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:10:47 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:10:47 user nova-compute[74721]:   </clock>
Nov 02 23:10:47 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:10:47 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:10:47 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:10:47 user nova-compute[74721]:   </cpu>
Nov 02 23:10:47 user nova-compute[74721]:   <devices>
Nov 02 23:10:47 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:10:47 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:10:47 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk"/>
Nov 02 23:10:47 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:10:47 user nova-compute[74721]:     </disk>
Nov 02 23:10:47 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:10:47 user nova-compute[74721]:       <mac address="fa:16:3e:69:27:a5"/>
Nov 02 23:10:47 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:10:47 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:10:47 user nova-compute[74721]:       <target dev="tapc5613433-17"/>
Nov 02 23:10:47 user nova-compute[74721]:     </interface>
Nov 02 23:10:47 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:10:47 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/console.log" append="off"/>
Nov 02 23:10:47 user nova-compute[74721]:     </serial>
Nov 02 23:10:47 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:10:47 user nova-compute[74721]:     <video>
Nov 02 23:10:47 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:10:47 user nova-compute[74721]:     </video>
Nov 02 23:10:47 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:10:47 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:10:47 user nova-compute[74721]:     </rng>
Nov 02 23:10:47 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:10:47 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:10:47 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:10:47 user nova-compute[74721]:     </memballoon>
Nov 02 23:10:47 user nova-compute[74721]:   </devices>
Nov 02 23:10:47 user nova-compute[74721]: </domain>
Nov 02 23:10:47 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318346580',display_name='tempest-VolumesNegativeTest-instance-318346580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318346580',id=29,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ddcc705b0884843930cd1a0b5403cd3',ramdisk_id='',reservation_id='r-wk0hei03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-130535392',owner_user_name='tempest-VolumesNegativeTest-130535392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:10:44Z,user_data=None,user_id='08b189befc4d4ee5b97979dbe65f3069',uuid=7440a338-7e3e-4160-908c-bc1bbe462d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converting VIF {"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG os_vif [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a11ee41d-0848-5769-8ba9-29c1863050e4', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5613433-17, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5613433-17, col_values=(('qos', UUID('de9dbe57-fdb9-40bd-9919-eccf7cdaf980')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5613433-17, col_values=(('external_ids', {'iface-id': 'c5613433-1700-4dc8-8536-284843531360', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:27:a5', 'vm-uuid': '7440a338-7e3e-4160-908c-bc1bbe462d11'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:47 user nova-compute[74721]: INFO os_vif [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17')
Nov 02 23:10:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] No VIF found with MAC fa:16:3e:69:27:a5, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:10:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:10:48 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:48 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7357MB free_disk=25.342567443847656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Updated VIF entry in instance network info cache for port c5613433-1700-4dc8-8536-284843531360. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.network.neutron [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Updating instance_info_cache with network_info: [{"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd34e223-1ee8-4ae3-9620-ac7936046ec1 req-12853201-7784-4b19-953c-8e5a44c0d85d service nova] Releasing lock "refresh_cache-7440a338-7e3e-4160-908c-bc1bbe462d11" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Applying migration context for instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 as it has an incoming, in-progress migration 424c04b0-9f5b-4f46-9410-49fdb8eedb3e. Migration status is finished {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 23:10:48 user nova-compute[74721]: INFO nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating resource usage from migration 424c04b0-9f5b-4f46-9410-49fdb8eedb3e
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 81b931c4-19b3-4a02-b002-bd3791508385 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Migration 424c04b0-9f5b-4f46-9410-49fdb8eedb3e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7440a338-7e3e-4160-908c-bc1bbe462d11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] No waiting events found dispatching network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:49 user nova-compute[74721]: WARNING nova.compute.manager [req-83817eb9-a015-4a6e-81ba-a6581a3e3684 req-cf3209ed-6aff-44f8-8727-9a67283f4dd2 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received unexpected event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 for instance with vm_state building and task_state spawning.
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] No waiting events found dispatching network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:10:51 user nova-compute[74721]: WARNING nova.compute.manager [req-141d9cb1-5aa0-4d27-ac27-437949fc5a34 req-fa364a13-0045-45c0-9123-ca7522b77015 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received unexpected event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 for instance with vm_state building and task_state spawning.
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:10:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Instance spawned successfully.
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:10:51 user nova-compute[74721]: INFO nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 02 23:10:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:10:51 user nova-compute[74721]: INFO nova.compute.manager [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Took 8.66 seconds to build instance.
Nov 02 23:10:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4dbee3c4-e2dc-415f-aefb-d94b0ba229ef tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.796s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:10:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:10:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:02 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d is timed out.
Nov 02 23:11:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d from the live domain config.
Nov 02 23:11:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQClZaFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:11:02 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e9fde-8e29-4f3c-9206-d3f775ce8d34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:11:02 user nova-compute[74721]: No targets found.
Nov 02 23:11:02 user nova-compute[74721]: iSNS:
Nov 02 23:11:02 user nova-compute[74721]: No targets found.
Nov 02 23:11:02 user nova-compute[74721]: STATIC:
Nov 02 23:11:02 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:11:02 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:02 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:02 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:11:02 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:02 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:02 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:11:02 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:02 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:02 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb
Nov 02 23:11:02 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:02 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:02 user nova-compute[74721]: FIRMWARE:
Nov 02 23:11:02 user nova-compute[74721]: No targets found.
Nov 02 23:11:02 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:11:02 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:11:02 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edebf95-4c99-46c2-8618-3c2806dd1051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48fb97-0d2f-4e45-b39a-646ca3ed0244]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:02 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf44baa0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b71e73-6e85-4ed1-a45a-57a47b91b0b6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06568ee2-3511-4607-a27c-3c2e076b6553]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dbc7af-b5d2-4ca4-8e81-594137a94f36]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:11:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[127827e0-9805-4c46-85d9-062553241b61]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db1c9b-827d-4faa-a44c-ead98fbb3031]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[30de72e9-5049-41bf-9f02-874b3e322f6d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260]
Nov 02 23:11:03 user nova-compute[74721]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb, portal: 172.16.0.220,3260] successful.
Nov 02 23:11:03 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9345b923-ff59-4252-8d43-6df06775e0eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5e7bf2-096b-4630-8105-3ae2e80e20c6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== disconnect_volume: return (419ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:11:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:11:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-948fee87-f79e-49f3-ad66-1b3b4baa10b0 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.351s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:13 user nova-compute[74721]: INFO nova.compute.manager [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Detaching volume a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:11:13 user nova-compute[74721]: INFO nova.virt.block_device [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Attempting to driver detach volume a2ab9321-5df0-4d84-94b6-499702ba7ec9 from mountpoint /dev/vdb
Nov 02 23:11:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Attempting to detach device vdb from instance 81b931c4-19b3-4a02-b002-bd3791508385 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:11:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:11:13 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:11:13 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:11:13 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:11:13 user nova-compute[74721]:   <serial>a2ab9321-5df0-4d84-94b6-499702ba7ec9</serial>
Nov 02 23:11:13 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:11:13 user nova-compute[74721]: </disk>
Nov 02 23:11:13 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:11:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully detached device vdb from instance 81b931c4-19b3-4a02-b002-bd3791508385 from the persistent domain config.
Nov 02 23:11:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81b931c4-19b3-4a02-b002-bd3791508385 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:11:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:11:13 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:11:13 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:11:13 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:11:13 user nova-compute[74721]:   <serial>a2ab9321-5df0-4d84-94b6-499702ba7ec9</serial>
Nov 02 23:11:13 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:11:13 user nova-compute[74721]: </disk>
Nov 02 23:11:13 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:11:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:11:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:11:15 user nova-compute[74721]: INFO nova.compute.claims [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Claim successful on node user
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:11:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.policy [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dc6f5e5ea0d4089998a6b8bff41c488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6216758d9b4e8abdb1840710239900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:11:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Creating image(s)
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "d74b863f3f72b6dc230b14f5cd90709003236f45" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "d74b863f3f72b6dc230b14f5cd90709003236f45" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG nova.virt.images [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] 3fdfb82a-ec4f-4bbc-8c4c-5585595dd577 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.part /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Successfully created port: 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.part /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.converted" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "d74b863f3f72b6dc230b14f5cd90709003236f45" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.026s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json" returned: 0 in 0.168s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "d74b863f3f72b6dc230b14f5cd90709003236f45" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "d74b863f3f72b6dc230b14f5cd90709003236f45" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45,backing_fmt=raw /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45,backing_fmt=raw /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk 1073741824" returned: 0 in 0.053s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "d74b863f3f72b6dc230b14f5cd90709003236f45" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Successfully updated port: 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing instance network info cache due to event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Cannot resize image /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Ensure instance console log exists: /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance network_info: |[{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start _get_guest_xml network_info=[{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T23:11:12Z,direct_url=<?>,disk_format='qcow2',id=3fdfb82a-ec4f-4bbc-8c4c-5585595dd577,min_disk=0,min_ram=0,name='tempest-scenario-img--760686048',owner='7e6216758d9b4e8abdb1840710239900',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T23:11:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '3fdfb82a-ec4f-4bbc-8c4c-5585595dd577'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:11:17 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:11:17 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T23:11:12Z,direct_url=<?>,disk_format='qcow2',id=3fdfb82a-ec4f-4bbc-8c4c-5585595dd577,min_disk=0,min_ram=0,name='tempest-scenario-img--760686048',owner='7e6216758d9b4e8abdb1840710239900',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T23:11:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:11:16Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'pci_devices' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:11:17 user nova-compute[74721]:   <uuid>185ac37f-d13e-4209-a195-a08acc8321c4</uuid>
Nov 02 23:11:17 user nova-compute[74721]:   <name>instance-0000001e</name>
Nov 02 23:11:17 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:11:17 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:11:17 user nova-compute[74721]:   <metadata>
Nov 02 23:11:17 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:11:17 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:name>tempest-TestMinimumBasicScenario-server-646288978</nova:name>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:11:17</nova:creationTime>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:11:17 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:11:17 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:owner>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:user uuid="2dc6f5e5ea0d4089998a6b8bff41c488">tempest-TestMinimumBasicScenario-493864842-project-member</nova:user>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:project uuid="7e6216758d9b4e8abdb1840710239900">tempest-TestMinimumBasicScenario-493864842</nova:project>
Nov 02 23:11:17 user nova-compute[74721]:       </nova:owner>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:root type="image" uuid="3fdfb82a-ec4f-4bbc-8c4c-5585595dd577"/>
Nov 02 23:11:17 user nova-compute[74721]:       <nova:ports>
Nov 02 23:11:17 user nova-compute[74721]:         <nova:port uuid="08acdf3d-6e0a-4b6f-9b4c-88731e6c0468">
Nov 02 23:11:17 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:11:17 user nova-compute[74721]:         </nova:port>
Nov 02 23:11:17 user nova-compute[74721]:       </nova:ports>
Nov 02 23:11:17 user nova-compute[74721]:     </nova:instance>
Nov 02 23:11:17 user nova-compute[74721]:   </metadata>
Nov 02 23:11:17 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:11:17 user nova-compute[74721]:     <system>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="serial">185ac37f-d13e-4209-a195-a08acc8321c4</entry>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="uuid">185ac37f-d13e-4209-a195-a08acc8321c4</entry>
Nov 02 23:11:17 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:11:17 user nova-compute[74721]:     </system>
Nov 02 23:11:17 user nova-compute[74721]:   </sysinfo>
Nov 02 23:11:17 user nova-compute[74721]:   <os>
Nov 02 23:11:17 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:11:17 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:11:17 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:11:17 user nova-compute[74721]:   </os>
Nov 02 23:11:17 user nova-compute[74721]:   <features>
Nov 02 23:11:17 user nova-compute[74721]:     <acpi/>
Nov 02 23:11:17 user nova-compute[74721]:     <apic/>
Nov 02 23:11:17 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:11:17 user nova-compute[74721]:   </features>
Nov 02 23:11:17 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:11:17 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:11:17 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:11:17 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:11:17 user nova-compute[74721]:   </clock>
Nov 02 23:11:17 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:11:17 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:11:17 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:11:17 user nova-compute[74721]:   </cpu>
Nov 02 23:11:17 user nova-compute[74721]:   <devices>
Nov 02 23:11:17 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:11:17 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:11:17 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk"/>
Nov 02 23:11:17 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:11:17 user nova-compute[74721]:     </disk>
Nov 02 23:11:17 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:11:17 user nova-compute[74721]:       <mac address="fa:16:3e:ac:50:65"/>
Nov 02 23:11:17 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:11:17 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:11:17 user nova-compute[74721]:       <target dev="tap08acdf3d-6e"/>
Nov 02 23:11:17 user nova-compute[74721]:     </interface>
Nov 02 23:11:17 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:11:17 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/console.log" append="off"/>
Nov 02 23:11:17 user nova-compute[74721]:     </serial>
Nov 02 23:11:17 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:11:17 user nova-compute[74721]:     <video>
Nov 02 23:11:17 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:11:17 user nova-compute[74721]:     </video>
Nov 02 23:11:17 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:11:17 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:11:17 user nova-compute[74721]:     </rng>
Nov 02 23:11:17 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:11:17 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:11:17 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:11:17 user nova-compute[74721]:     </memballoon>
Nov 02 23:11:17 user nova-compute[74721]:   </devices>
Nov 02 23:11:17 user nova-compute[74721]: </domain>
Nov 02 23:11:17 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:11:16Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG os_vif [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4e7867e-b994-5a17-b9e9-460ee4b03243', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08acdf3d-6e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08acdf3d-6e, col_values=(('qos', UUID('873f8886-2083-475d-947a-a4aef8016c0f')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08acdf3d-6e, col_values=(('external_ids', {'iface-id': '08acdf3d-6e0a-4b6f-9b4c-88731e6c0468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:50:65', 'vm-uuid': '185ac37f-d13e-4209-a195-a08acc8321c4'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:17 user nova-compute[74721]: INFO os_vif [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e')
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:11:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No VIF found with MAC fa:16:3e:ac:50:65, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:11:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated VIF entry in instance network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:11:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbec65b0-e68f-4535-b60d-3800813615b4 req-05cea830-6a94-4d83-8b5d-bdfee80c0f50 service nova] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:19 user nova-compute[74721]: WARNING nova.compute.manager [req-57e2d15b-d9cd-494e-903d-9df1416ed024 req-366144cb-d884-4288-860a-34bc641c6b46 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state building and task_state spawning.
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:11:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance spawned successfully.
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:11:21 user nova-compute[74721]: INFO nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:21 user nova-compute[74721]: WARNING nova.compute.manager [req-cd619b80-5ab6-40a7-ae5f-71c7af353989 req-7fb0a253-07bd-4ef3-aeb3-05271c3d3c9f service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state building and task_state spawning.
Nov 02 23:11:21 user nova-compute[74721]: INFO nova.compute.manager [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Took 6.61 seconds to build instance.
Nov 02 23:11:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5d155069-7000-4aa5-b6ab-6ff53a9fd04b tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.702s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-changed-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Refreshing instance network info cache due to event network-changed-40f79c3b-70d5-4319-a9de-8f49f58f4945. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:11:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] Acquiring lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:11:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] Acquired lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:11:31 user nova-compute[74721]: DEBUG nova.network.neutron [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Refreshing network info cache for port 40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updated VIF entry in instance network info cache for port 40f79c3b-70d5-4319-a9de-8f49f58f4945. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-560ea1d1-a75b-47d6-90f4-d97bd794df30 req-9091584a-e12d-43d6-9089-5b695885658f service nova] Releasing lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:32 user nova-compute[74721]: INFO nova.compute.manager [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Terminating instance
Nov 02 23:11:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Instance destroyed successfully.
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'resources' on Instance uuid adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-247955098',display_name='tempest-AttachVolumeNegativeTest-server-247955098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-247955098',id=19,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu5nKjH+hw6XpGhVbIPppb5lCK1jSG1+PX4qFBjn96ef1hTOrZssEoFAyto3xVVG0n9pSOHZrehohs4X2BbTBnwtDChjQ9pQnj3sCgWMbfe4OSQcjSpfBuMzBap3kgLzw==',key_name='tempest-keypair-1359130630',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-haykdqsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "address": "fa:16:3e:e0:d6:46", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4c963e-8e", "ovs_interfaceid": "ba4c963e-8ead-4200-8ff3-805e08aa0460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG os_vif [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4c963e-8e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2703d363-adb7-47db-b664-d5a070f89ea0) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:33 user nova-compute[74721]: INFO os_vif [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d6:46,bridge_name='br-int',has_traffic_filtering=True,id=ba4c963e-8ead-4200-8ff3-805e08aa0460,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4c963e-8e')
Nov 02 23:11:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Deleting instance files /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d_del
Nov 02 23:11:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Deletion of /opt/stack/data/nova/instances/adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d_del complete
Nov 02 23:11:33 user nova-compute[74721]: INFO nova.compute.manager [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-unplugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] No waiting events found dispatching network-vif-unplugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-unplugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Acquiring lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] No waiting events found dispatching network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:33 user nova-compute[74721]: WARNING nova.compute.manager [req-6d1aae8d-804e-4c36-aa16-93e585ff825c req-5c2144a7-23d0-439b-bd03-8925b523581d service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received unexpected event network-vif-plugged-ba4c963e-8ead-4200-8ff3-805e08aa0460 for instance with vm_state active and task_state deleting.
Nov 02 23:11:33 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:34 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Took 0.75 seconds to deallocate network for instance.
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:34 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81b931c4-19b3-4a02-b002-bd3791508385 is timed out.
Nov 02 23:11:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully detached device vdb from instance 81b931c4-19b3-4a02-b002-bd3791508385 from the live domain config.
Nov 02 23:11:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMAcRYPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:11:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c3852b-0ab5-408e-aed3-229fa2e114c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:11:34 user nova-compute[74721]: No targets found.
Nov 02 23:11:34 user nova-compute[74721]: iSNS:
Nov 02 23:11:34 user nova-compute[74721]: No targets found.
Nov 02 23:11:34 user nova-compute[74721]: STATIC:
Nov 02 23:11:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9
Nov 02 23:11:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:11:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:11:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:34 user nova-compute[74721]: FIRMWARE:
Nov 02 23:11:34 user nova-compute[74721]: No targets found.
Nov 02 23:11:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:11:34 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:11:34 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f4f825-2926-42bd-b1b6-622b1bc4fac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c6e18-df1d-4c9f-be7a-91c3ea04b500]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24376830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a58e319-3ca2-4941-8835-d1213970d779]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b8bacc-caf0-4817-807f-585f06fe8581]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1eb1a2-77a1-4f9a-a376-a08bf78d0ac8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc228e3b-513e-4ec3-ba75-209afa8a5356]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e545b2-5164-4a1f-8479-f132f028163c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630b696-d2ad-4abf-8285-45a47876b01d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260]
Nov 02 23:11:34 user nova-compute[74721]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9, portal: 172.16.0.220,3260] successful.
Nov 02 23:11:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:34 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Deleted allocations for instance adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d4600-d033-4180-ae50-15f3a4108c04]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== disconnect_volume: return (352ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-123c691b-6d41-4c6b-8e1d-418e4357c8ad tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8920a1f7-713e-48f4-b686-bfb8cc7af61c tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.140s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.990s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:35 user nova-compute[74721]: INFO nova.compute.manager [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Terminating instance
Nov 02 23:11:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-dad8fbcc-2976-43bb-bae4-742dbdf1f6dd req-5a13fb56-905f-4be7-997a-31bf1d4acd5e service nova] [instance: adfa1a5b-0b15-42fd-80cf-56f4e5e5cc2d] Received event network-vif-deleted-ba4c963e-8ead-4200-8ff3-805e08aa0460 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-unplugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] No waiting events found dispatching network-vif-unplugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-f7210a24-2e82-4c52-a1dc-8526242d877f req-14dec2b2-5454-4d9b-b705-536ffe459bb1 service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-unplugged-d90c976e-9859-4d95-9a13-6dcb5d46724f for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Instance destroyed successfully.
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.objects.instance [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'resources' on Instance uuid 81b931c4-19b3-4a02-b002-bd3791508385 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2073498056',display_name='tempest-VolumesSnapshotTestJSON-instance-2073498056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2073498056',id=22,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyDedSSdrxcKOPHnt2z46UFkzF2O0LdBLTLoGLE+VpYRnNX9xAh3Wm9ssM8EXr8x6k56PlmSMCGsfKOKE3NP8Otj5ddv/skpF0ZQP3jK4oogEXU8pSM/CzTjhcjn5bluQ==',key_name='tempest-keypair-1895928751',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:07:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-3ib7ivbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=81b931c4-19b3-4a02-b002-bd3791508385,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "address": "fa:16:3e:e5:a9:75", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90c976e-98", "ovs_interfaceid": "d90c976e-9859-4d95-9a13-6dcb5d46724f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_vif [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd90c976e-98, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=716e0bdd-1e4f-4118-a947-9fdef2573e3f) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:11:36 user nova-compute[74721]: INFO os_vif [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:75,bridge_name='br-int',has_traffic_filtering=True,id=d90c976e-9859-4d95-9a13-6dcb5d46724f,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90c976e-98')
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMAcRYPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:11:36 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[89386fdf-92b8-4b46-901a-f733011cba7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:11:36 user nova-compute[74721]: No targets found.
Nov 02 23:11:36 user nova-compute[74721]: iSNS:
Nov 02 23:11:36 user nova-compute[74721]: No targets found.
Nov 02 23:11:36 user nova-compute[74721]: STATIC:
Nov 02 23:11:36 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:11:36 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:36 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:36 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:11:36 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:11:36 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:11:36 user nova-compute[74721]: FIRMWARE:
Nov 02 23:11:36 user nova-compute[74721]: No targets found.
Nov 02 23:11:36 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:11:36 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:11:36 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab9321-5df0-4d84-94b6-499702ba7ec9', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea24d76-20f8-4a7c-8d3f-4e7b4bee7c7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7cbf5-fa9f-48a9-8488-7107d6aec9fa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:36 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:36 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:11:36 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:11:36 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c3aa9e0>, {}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Disconnecting from: [] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== disconnect_volume: return (85ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:11:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Deleting instance files /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385_del
Nov 02 23:11:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Deletion of /opt/stack/data/nova/instances/81b931c4-19b3-4a02-b002-bd3791508385_del complete
Nov 02 23:11:36 user nova-compute[74721]: INFO nova.compute.manager [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Skipping network cache update for instance because it is being deleted. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:11:36 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:37 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:37 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Took 1.14 seconds to deallocate network for instance.
Nov 02 23:11:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-2e1e3d1f-5e28-4b58-9f15-d604e932b492 req-37a0a919-f47f-46e9-8191-06babc67d18b service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-deleted-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:37 user nova-compute[74721]: WARNING nova.volume.cinder [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Attachment 570ba258-e0a7-40c5-85c2-ac78f5928775 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 570ba258-e0a7-40c5-85c2-ac78f5928775. (HTTP 404) (Request-ID: req-308535e4-5eb6-420f-b9eb-b93bacb286b2)
Nov 02 23:11:37 user nova-compute[74721]: INFO nova.compute.manager [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Took 0.02 seconds to detach 1 volumes for instance.
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] Acquiring lock "81b931c4-19b3-4a02-b002-bd3791508385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] Lock "81b931c4-19b3-4a02-b002-bd3791508385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] No waiting events found dispatching network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:11:38 user nova-compute[74721]: WARNING nova.compute.manager [req-4850f529-f3ec-45ec-a344-c151edd96b84 req-635c63e0-10f2-4a90-adcf-d35e412a64fb service nova] [instance: 81b931c4-19b3-4a02-b002-bd3791508385] Received unexpected event network-vif-plugged-d90c976e-9859-4d95-9a13-6dcb5d46724f for instance with vm_state deleted and task_state None.
Nov 02 23:11:38 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:38 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Deleted allocations for instance 81b931c4-19b3-4a02-b002-bd3791508385
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-434313a0-f772-4ff0-9af1-4753aebc4068 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "81b931c4-19b3-4a02-b002-bd3791508385" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:38 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Going to confirm migration 2 {{(pid=74721) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 02 23:11:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquired lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'info_cache' on Instance uuid 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [{"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Releasing lock "refresh_cache-4043343b-caf6-4c8d-bdfb-cbed139e2ba6" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'migration_context' on Instance uuid 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.objects.base [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Object Instance<4043343b-caf6-4c8d-bdfb-cbed139e2ba6> lazy-loaded attributes: info_cache,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:11:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:11:42 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:11:42 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:11:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.692s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:42 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Deleted allocation for migration 424c04b0-9f5b-4f46-9410-49fdb8eedb3e
Nov 02 23:11:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5384bcca-bb92-4b4b-8881-ed6416bb5674 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.659s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:11:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:11:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:11:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=25.295940399169922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7440a338-7e3e-4160-908c-bc1bbe462d11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:11:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:11:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:11:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:02 user nova-compute[74721]: INFO nova.compute.manager [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attaching volume 6944f5ce-70a3-48c4-ab67-0d96ff294173 to /dev/vdb
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.utils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9395f2ca-60cb-4f77-998b-7b110974e39a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3024e-3f3d-4af7-87be-d4e241bb4636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[087fd63f-c807-4375-83d0-ef76c7d98e57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ed8a0d-7c5c-4033-80a1-abbda3d8b174]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:12:02 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:12:02 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0c9a5-865c-40dd-9e76-bb796bcf74fe]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG os_brick.utils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:12:02 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating existing volume attachment record: c86cf0ea-db28-435f-a942-5819a53d38ad {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:12:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_power_states {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 848014b4-7b18-46ac-aa18-d85ad52c6eef {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 7440a338-7e3e-4160-908c-bc1bbe462d11 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f539868-3357-4719-a715-39ab06bf8898" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3f539868-3357-4719-a715-39ab06bf8898" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:12:27 user nova-compute[74721]: INFO nova.compute.claims [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Claim successful on node user
Nov 02 23:12:27 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:12:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.policy [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83010d67d3514cd69c99767c0b77fb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd99aa517e74a5aa15c46d174a025b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:12:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Creating image(s)
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk 1073741824" returned: 0 in 0.054s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Successfully created port: 4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:12:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Cannot resize image /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Ensure instance console log exists: /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Successfully updated port: 4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquired lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-changed-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Refreshing instance network info cache due to event network-changed-4dd62ad6-608e-4bea-8b3a-0e30c0d91688. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] Acquiring lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updating instance_info_cache with network_info: [{"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Releasing lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Instance network_info: |[{"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] Acquired lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.neutron [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Refreshing network info cache for port 4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Start _get_guest_xml network_info=[{"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:12:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:30 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740181398',display_name='tempest-AttachVolumeNegativeTest-server-740181398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740181398',id=31,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDkaQPuFxMtFaJCqRXHowx2IA+zJVTNrhhrkhZ4II/4MnP02OtrScjoFWAZaTf7xmM17oAlcd8XYg9KOWQPMuW0yCVJli4w+/BZcNGQbJy4nV7Gsr3ggb+VRhCZas+8LQ==',key_name='tempest-keypair-636253626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-jlm85yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:12:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=b7645d21-5b03-4efb-9049-3178c9384108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.objects.instance [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'pci_devices' on Instance uuid b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:12:30 user nova-compute[74721]:   <uuid>b7645d21-5b03-4efb-9049-3178c9384108</uuid>
Nov 02 23:12:30 user nova-compute[74721]:   <name>instance-0000001f</name>
Nov 02 23:12:30 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:12:30 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:12:30 user nova-compute[74721]:   <metadata>
Nov 02 23:12:30 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:12:30 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeNegativeTest-server-740181398</nova:name>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:12:30</nova:creationTime>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:12:30 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:12:30 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:owner>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:user uuid="83010d67d3514cd69c99767c0b77fb67">tempest-AttachVolumeNegativeTest-1503140472-project-member</nova:user>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:project uuid="0bd99aa517e74a5aa15c46d174a025b0">tempest-AttachVolumeNegativeTest-1503140472</nova:project>
Nov 02 23:12:30 user nova-compute[74721]:       </nova:owner>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:12:30 user nova-compute[74721]:       <nova:ports>
Nov 02 23:12:30 user nova-compute[74721]:         <nova:port uuid="4dd62ad6-608e-4bea-8b3a-0e30c0d91688">
Nov 02 23:12:30 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 23:12:30 user nova-compute[74721]:         </nova:port>
Nov 02 23:12:30 user nova-compute[74721]:       </nova:ports>
Nov 02 23:12:30 user nova-compute[74721]:     </nova:instance>
Nov 02 23:12:30 user nova-compute[74721]:   </metadata>
Nov 02 23:12:30 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:12:30 user nova-compute[74721]:     <system>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="serial">b7645d21-5b03-4efb-9049-3178c9384108</entry>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="uuid">b7645d21-5b03-4efb-9049-3178c9384108</entry>
Nov 02 23:12:30 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:12:30 user nova-compute[74721]:     </system>
Nov 02 23:12:30 user nova-compute[74721]:   </sysinfo>
Nov 02 23:12:30 user nova-compute[74721]:   <os>
Nov 02 23:12:30 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:12:30 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:12:30 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:12:30 user nova-compute[74721]:   </os>
Nov 02 23:12:30 user nova-compute[74721]:   <features>
Nov 02 23:12:30 user nova-compute[74721]:     <acpi/>
Nov 02 23:12:30 user nova-compute[74721]:     <apic/>
Nov 02 23:12:30 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:12:30 user nova-compute[74721]:   </features>
Nov 02 23:12:30 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:12:30 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:12:30 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:12:30 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:12:30 user nova-compute[74721]:   </clock>
Nov 02 23:12:30 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:12:30 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:12:30 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:12:30 user nova-compute[74721]:   </cpu>
Nov 02 23:12:30 user nova-compute[74721]:   <devices>
Nov 02 23:12:30 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:12:30 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:12:30 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk"/>
Nov 02 23:12:30 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:12:30 user nova-compute[74721]:     </disk>
Nov 02 23:12:30 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:12:30 user nova-compute[74721]:       <mac address="fa:16:3e:dd:df:8d"/>
Nov 02 23:12:30 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:30 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:12:30 user nova-compute[74721]:       <target dev="tap4dd62ad6-60"/>
Nov 02 23:12:30 user nova-compute[74721]:     </interface>
Nov 02 23:12:30 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:12:30 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/console.log" append="off"/>
Nov 02 23:12:30 user nova-compute[74721]:     </serial>
Nov 02 23:12:30 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:12:30 user nova-compute[74721]:     <video>
Nov 02 23:12:30 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:30 user nova-compute[74721]:     </video>
Nov 02 23:12:30 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:12:30 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:12:30 user nova-compute[74721]:     </rng>
Nov 02 23:12:30 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:12:30 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:12:30 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:12:30 user nova-compute[74721]:     </memballoon>
Nov 02 23:12:30 user nova-compute[74721]:   </devices>
Nov 02 23:12:30 user nova-compute[74721]: </domain>
Nov 02 23:12:30 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740181398',display_name='tempest-AttachVolumeNegativeTest-server-740181398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740181398',id=31,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDkaQPuFxMtFaJCqRXHowx2IA+zJVTNrhhrkhZ4II/4MnP02OtrScjoFWAZaTf7xmM17oAlcd8XYg9KOWQPMuW0yCVJli4w+/BZcNGQbJy4nV7Gsr3ggb+VRhCZas+8LQ==',key_name='tempest-keypair-636253626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-jlm85yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:12:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=b7645d21-5b03-4efb-9049-3178c9384108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG os_vif [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fed0a54-a887-52d5-91d5-3c0a0bfd8b97', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dd62ad6-60, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dd62ad6-60, col_values=(('qos', UUID('2528b9ba-d24d-4084-893f-ed8b1a1aec14')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dd62ad6-60, col_values=(('external_ids', {'iface-id': '4dd62ad6-608e-4bea-8b3a-0e30c0d91688', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:df:8d', 'vm-uuid': 'b7645d21-5b03-4efb-9049-3178c9384108'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:30 user nova-compute[74721]: INFO os_vif [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60')
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:dd:df:8d, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.neutron [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updated VIF entry in instance network info cache for port 4dd62ad6-608e-4bea-8b3a-0e30c0d91688. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG nova.network.neutron [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updating instance_info_cache with network_info: [{"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7550f1a8-64f0-4fa4-88ea-f1aaf0283afa req-f3c8fd9e-4d1f-4dd2-a429-f750034c74d0 service nova] Releasing lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] No waiting events found dispatching network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:32 user nova-compute[74721]: WARNING nova.compute.manager [req-22be5c34-8ec9-4a8c-834c-7adaf2e94505 req-466aa1e7-fb3f-4c80-bf8c-6c8b2030eddd service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received unexpected event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 for instance with vm_state building and task_state spawning.
Nov 02 23:12:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:12:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:33 user nova-compute[74721]: INFO nova.compute.manager [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Terminating instance
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-unplugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] No waiting events found dispatching network-vif-unplugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-96bde4c1-2ca0-4e4a-9276-a0d2f73e61cc req-89edb830-11fe-44c6-b6b3-748cac5af8c5 service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-unplugged-c5613433-1700-4dc8-8536-284843531360 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:12:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Instance destroyed successfully.
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lazy-loading 'resources' on Instance uuid 7440a338-7e3e-4160-908c-bc1bbe462d11 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318346580',display_name='tempest-VolumesNegativeTest-instance-318346580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318346580',id=29,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:10:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ddcc705b0884843930cd1a0b5403cd3',ramdisk_id='',reservation_id='r-wk0hei03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-130535392',owner_user_name='tempest-VolumesNegativeTest-130535392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:10:52Z,user_data=None,user_id='08b189befc4d4ee5b97979dbe65f3069',uuid=7440a338-7e3e-4160-908c-bc1bbe462d11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converting VIF {"id": "c5613433-1700-4dc8-8536-284843531360", "address": "fa:16:3e:69:27:a5", "network": {"id": "2130c475-1239-48b9-99e0-6b9da3bfb9f7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b33085dace814e56b515e6d436a2e9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5613433-17", "ovs_interfaceid": "c5613433-1700-4dc8-8536-284843531360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG os_vif [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5613433-17, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de9dbe57-fdb9-40bd-9919-eccf7cdaf980) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [{"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:33 user nova-compute[74721]: INFO os_vif [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:27:a5,bridge_name='br-int',has_traffic_filtering=True,id=c5613433-1700-4dc8-8536-284843531360,network=Network(2130c475-1239-48b9-99e0-6b9da3bfb9f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5613433-17')
Nov 02 23:12:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Deleting instance files /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11_del
Nov 02 23:12:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Deletion of /opt/stack/data/nova/instances/7440a338-7e3e-4160-908c-bc1bbe462d11_del complete
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3f539868-3357-4719-a715-39ab06bf8898" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:33 user nova-compute[74721]: INFO nova.compute.manager [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 23:12:33 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:12:33 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] No waiting events found dispatching network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:34 user nova-compute[74721]: WARNING nova.compute.manager [req-fcce3aef-85a2-4d8e-b47b-cffa7c76ccd4 req-83d051bc-0ed2-4473-a218-95ec0bdffa37 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received unexpected event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 for instance with vm_state building and task_state spawning.
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:12:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Instance spawned successfully.
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:12:34 user nova-compute[74721]: INFO nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:34 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Took 0.59 seconds to deallocate network for instance.
Nov 02 23:12:34 user nova-compute[74721]: INFO nova.compute.manager [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Took 7.26 seconds to build instance.
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-613bde08-8c34-4056-a812-29332dc3bfc9 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:34 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:35 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Deleted allocations for instance 7440a338-7e3e-4160-908c-bc1bbe462d11
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f0db3245-f99d-4f06-b507-b295df0f42fb tempest-VolumesNegativeTest-130535392 tempest-VolumesNegativeTest-130535392-project-member] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] Acquiring lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] Lock "7440a338-7e3e-4160-908c-bc1bbe462d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] No waiting events found dispatching network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:35 user nova-compute[74721]: WARNING nova.compute.manager [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received unexpected event network-vif-plugged-c5613433-1700-4dc8-8536-284843531360 for instance with vm_state deleted and task_state None.
Nov 02 23:12:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-675d5c78-3a04-4c21-b7d0-eee548fe4b8e req-be642309-83c6-4e99-9180-f28c2fc54cfc service nova] [instance: 7440a338-7e3e-4160-908c-bc1bbe462d11] Received event network-vif-deleted-c5613433-1700-4dc8-8536-284843531360 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:12:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:37 user nova-compute[74721]: INFO nova.compute.manager [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Rescuing
Nov 02 23:12:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:38 user nova-compute[74721]: WARNING nova.compute.manager [req-3b79ee67-ead3-40a5-bc8e-9f205ef39843 req-335254fd-2a35-45ae-b393-250057da5d40 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state active and task_state rescuing.
Nov 02 23:12:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance destroyed successfully.
Nov 02 23:12:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Attempting rescue
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:12:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Creating image(s)
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.236s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue" returned: 0 in 0.059s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'migration_context' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.base [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<ed86a8bd-c846-431f-adf5-c990136d5e85> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start _get_guest_xml network_info=[{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:8b:6f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.base [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<ed86a8bd-c846-431f-adf5-c990136d5e85> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'numa_topology' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.base [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<ed86a8bd-c846-431f-adf5-c990136d5e85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:12:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:39 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.base [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<ed86a8bd-c846-431f-adf5-c990136d5e85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2029541802',display_name='tempest-ServerRescueNegativeTestJSON-server-2029541802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2029541802',id=23,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-4vh1kk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:08:01Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=ed86a8bd-c846-431f-adf5-c990136d5e85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:8b:6f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:8b:6f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.objects.base [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<ed86a8bd-c846-431f-adf5-c990136d5e85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:12:39 user nova-compute[74721]:   <uuid>ed86a8bd-c846-431f-adf5-c990136d5e85</uuid>
Nov 02 23:12:39 user nova-compute[74721]:   <name>instance-00000017</name>
Nov 02 23:12:39 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:12:39 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:12:39 user nova-compute[74721]:   <metadata>
Nov 02 23:12:39 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:12:39 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2029541802</nova:name>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:12:39</nova:creationTime>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:12:39 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:12:39 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:owner>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:12:39 user nova-compute[74721]:       </nova:owner>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:12:39 user nova-compute[74721]:       <nova:ports>
Nov 02 23:12:39 user nova-compute[74721]:         <nova:port uuid="a9c2b78d-27f7-43b5-9a40-7330ef5cf205">
Nov 02 23:12:39 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:12:39 user nova-compute[74721]:         </nova:port>
Nov 02 23:12:39 user nova-compute[74721]:       </nova:ports>
Nov 02 23:12:39 user nova-compute[74721]:     </nova:instance>
Nov 02 23:12:39 user nova-compute[74721]:   </metadata>
Nov 02 23:12:39 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:12:39 user nova-compute[74721]:     <system>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="serial">ed86a8bd-c846-431f-adf5-c990136d5e85</entry>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="uuid">ed86a8bd-c846-431f-adf5-c990136d5e85</entry>
Nov 02 23:12:39 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:12:39 user nova-compute[74721]:     </system>
Nov 02 23:12:39 user nova-compute[74721]:   </sysinfo>
Nov 02 23:12:39 user nova-compute[74721]:   <os>
Nov 02 23:12:39 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:12:39 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:12:39 user nova-compute[74721]:   </os>
Nov 02 23:12:39 user nova-compute[74721]:   <features>
Nov 02 23:12:39 user nova-compute[74721]:     <acpi/>
Nov 02 23:12:39 user nova-compute[74721]:     <apic/>
Nov 02 23:12:39 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:12:39 user nova-compute[74721]:   </features>
Nov 02 23:12:39 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:12:39 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:12:39 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:12:39 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:12:39 user nova-compute[74721]:   </clock>
Nov 02 23:12:39 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:12:39 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:12:39 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:12:39 user nova-compute[74721]:   </cpu>
Nov 02 23:12:39 user nova-compute[74721]:   <devices>
Nov 02 23:12:39 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:12:39 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:12:39 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue"/>
Nov 02 23:12:39 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:12:39 user nova-compute[74721]:     </disk>
Nov 02 23:12:39 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:12:39 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:12:39 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk"/>
Nov 02 23:12:39 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:12:39 user nova-compute[74721]:     </disk>
Nov 02 23:12:39 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:12:39 user nova-compute[74721]:       <mac address="fa:16:3e:8b:6f:d1"/>
Nov 02 23:12:39 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:39 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:12:39 user nova-compute[74721]:       <target dev="tapa9c2b78d-27"/>
Nov 02 23:12:39 user nova-compute[74721]:     </interface>
Nov 02 23:12:39 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:12:39 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/console.log" append="off"/>
Nov 02 23:12:39 user nova-compute[74721]:     </serial>
Nov 02 23:12:39 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:12:39 user nova-compute[74721]:     <video>
Nov 02 23:12:39 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:39 user nova-compute[74721]:     </video>
Nov 02 23:12:39 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:12:39 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:12:39 user nova-compute[74721]:     </rng>
Nov 02 23:12:39 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:12:39 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:12:39 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:12:39 user nova-compute[74721]:     </memballoon>
Nov 02 23:12:39 user nova-compute[74721]:   </devices>
Nov 02 23:12:39 user nova-compute[74721]: </domain>
Nov 02 23:12:39 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:12:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance destroyed successfully.
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:8b:6f:d1, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:12:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:40 user nova-compute[74721]: WARNING nova.compute.manager [req-b87eb4f1-5d62-438a-83e7-a42c23889f2b req-8db70886-c9a7-48c8-8c66-166bd753e62d service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state active and task_state rescuing.
Nov 02 23:12:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:42 user nova-compute[74721]: WARNING nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state active and task_state rescuing.
Nov 02 23:12:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:42 user nova-compute[74721]: WARNING nova.compute.manager [req-ee8d222c-07e9-4e65-a0a8-4cf328f3e88f req-93b55669-eeca-449e-97b3-79d64905d366 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state active and task_state rescuing.
Nov 02 23:12:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6c3a510e-b741-4608-8b7d-1bf7efa6160f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:12:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:12:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:44 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtkIqzsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:12:45 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:12:45 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:12:45 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18cd289-9106-4eb8-b195-488f253ad5a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:12:45 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6bb671-fb1a-4dd5-8a08-91e123aef4f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173] added
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c71b9-1020-40a9-9d63-2e76b08a438c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfbe00b-af6c-4288-875a-ece6e4f399ab]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtkIqzsX {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtkIqzsX" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e819fec-b1cc-43b9-878e-7990cca7e643]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QtkIqzsX'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b81dd-beb3-483d-9fbf-12479ea72e9b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e8cd5-42d5-47c0-8fe3-11da138db19e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef31848-86c9-440c-b4c1-7b7fe2196ece]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260]
Nov 02 23:12:45 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260] successful.
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad4efc-c4e9-4aef-8c49-d4817a1259d1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[52947cb5-3b66-4638-a2ef-d4b7d360d322]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)
Nov 02 23:12:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54953009-2e2b-40a7-bb9c-8066ff8fcf53]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtkIqzsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23832346136396233', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832346136396233', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:12:46 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:12:46 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:12:46 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:12:46 user nova-compute[74721]:   <serial>6944f5ce-70a3-48c4-ab67-0d96ff294173</serial>
Nov 02 23:12:46 user nova-compute[74721]: </disk>
Nov 02 23:12:46 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No VIF found with MAC fa:16:3e:ac:49:ba, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2f213bc2-6a17-4005-a701-800289f45588 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.410s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 31.084s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:50 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:50 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7436MB free_disk=25.292423248291016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b7645d21-5b03-4efb-9049-3178c9384108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:12:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:55 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:12:55 user nova-compute[74721]: INFO nova.compute.claims [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Claim successful on node user
Nov 02 23:12:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:12:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.policy [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098f64e0da7c457e8845a970d41294b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52745a8a23e0448c8e9e484dc3fc1ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:12:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Creating image(s)
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "/opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "/opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "/opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk 1073741824" returned: 0 in 0.062s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Successfully created port: ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:12:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Cannot resize image /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Ensure instance console log exists: /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Successfully updated port: ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquired lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-changed-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Refreshing instance network info cache due to event network-changed-ab975b5c-f72d-4a8c-8b11-f916b880ed3a. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] Acquiring lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating instance_info_cache with network_info: [{"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Releasing lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Instance network_info: |[{"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] Acquired lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.neutron [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Refreshing network info cache for port ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Start _get_guest_xml network_info=[{"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:12:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1329067754',display_name='tempest-VolumesSnapshotTestJSON-instance-1329067754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1329067754',id=32,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbpTxBBwW+20VW+lF7Da2np4EUGUwhV6Afa6ryu3LL0Ra/HPEShaTcPOMLKkeSqcS2H21bZ6HEAUYblpluYm77EwUjvXDivjUOMmxKFd9Z+M2oWCUmDDzJhq/xhr8rKPA==',key_name='tempest-keypair-1081505893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-jn1lupk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=15cd8cea-8506-43da-b3c6-69412acbae96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'pci_devices' on Instance uuid 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:12:57 user nova-compute[74721]:   <uuid>15cd8cea-8506-43da-b3c6-69412acbae96</uuid>
Nov 02 23:12:57 user nova-compute[74721]:   <name>instance-00000020</name>
Nov 02 23:12:57 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:12:57 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:12:57 user nova-compute[74721]:   <metadata>
Nov 02 23:12:57 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:12:57 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1329067754</nova:name>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:12:57</nova:creationTime>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:12:57 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:12:57 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:owner>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:user uuid="098f64e0da7c457e8845a970d41294b9">tempest-VolumesSnapshotTestJSON-372484288-project-member</nova:user>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:project uuid="52745a8a23e0448c8e9e484dc3fc1ac4">tempest-VolumesSnapshotTestJSON-372484288</nova:project>
Nov 02 23:12:57 user nova-compute[74721]:       </nova:owner>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:12:57 user nova-compute[74721]:       <nova:ports>
Nov 02 23:12:57 user nova-compute[74721]:         <nova:port uuid="ab975b5c-f72d-4a8c-8b11-f916b880ed3a">
Nov 02 23:12:57 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:12:57 user nova-compute[74721]:         </nova:port>
Nov 02 23:12:57 user nova-compute[74721]:       </nova:ports>
Nov 02 23:12:57 user nova-compute[74721]:     </nova:instance>
Nov 02 23:12:57 user nova-compute[74721]:   </metadata>
Nov 02 23:12:57 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:12:57 user nova-compute[74721]:     <system>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="serial">15cd8cea-8506-43da-b3c6-69412acbae96</entry>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="uuid">15cd8cea-8506-43da-b3c6-69412acbae96</entry>
Nov 02 23:12:57 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:12:57 user nova-compute[74721]:     </system>
Nov 02 23:12:57 user nova-compute[74721]:   </sysinfo>
Nov 02 23:12:57 user nova-compute[74721]:   <os>
Nov 02 23:12:57 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:12:57 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:12:57 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:12:57 user nova-compute[74721]:   </os>
Nov 02 23:12:57 user nova-compute[74721]:   <features>
Nov 02 23:12:57 user nova-compute[74721]:     <acpi/>
Nov 02 23:12:57 user nova-compute[74721]:     <apic/>
Nov 02 23:12:57 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:12:57 user nova-compute[74721]:   </features>
Nov 02 23:12:57 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:12:57 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:12:57 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:12:57 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:12:57 user nova-compute[74721]:   </clock>
Nov 02 23:12:57 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:12:57 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:12:57 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:12:57 user nova-compute[74721]:   </cpu>
Nov 02 23:12:57 user nova-compute[74721]:   <devices>
Nov 02 23:12:57 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:12:57 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:12:57 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk"/>
Nov 02 23:12:57 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:12:57 user nova-compute[74721]:     </disk>
Nov 02 23:12:57 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:12:57 user nova-compute[74721]:       <mac address="fa:16:3e:e2:f8:1c"/>
Nov 02 23:12:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:57 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:12:57 user nova-compute[74721]:       <target dev="tapab975b5c-f7"/>
Nov 02 23:12:57 user nova-compute[74721]:     </interface>
Nov 02 23:12:57 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:12:57 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/console.log" append="off"/>
Nov 02 23:12:57 user nova-compute[74721]:     </serial>
Nov 02 23:12:57 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:12:57 user nova-compute[74721]:     <video>
Nov 02 23:12:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:12:57 user nova-compute[74721]:     </video>
Nov 02 23:12:57 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:12:57 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:12:57 user nova-compute[74721]:     </rng>
Nov 02 23:12:57 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:12:57 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:12:57 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:12:57 user nova-compute[74721]:     </memballoon>
Nov 02 23:12:57 user nova-compute[74721]:   </devices>
Nov 02 23:12:57 user nova-compute[74721]: </domain>
Nov 02 23:12:57 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1329067754',display_name='tempest-VolumesSnapshotTestJSON-instance-1329067754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1329067754',id=32,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbpTxBBwW+20VW+lF7Da2np4EUGUwhV6Afa6ryu3LL0Ra/HPEShaTcPOMLKkeSqcS2H21bZ6HEAUYblpluYm77EwUjvXDivjUOMmxKFd9Z+M2oWCUmDDzJhq/xhr8rKPA==',key_name='tempest-keypair-1081505893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-jn1lupk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=15cd8cea-8506-43da-b3c6-69412acbae96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG os_vif [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ce04b95-203a-5d14-89b0-14b37f632405', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab975b5c-f7, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab975b5c-f7, col_values=(('qos', UUID('62beadd6-91fd-418d-afa5-207079df7b20')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab975b5c-f7, col_values=(('external_ids', {'iface-id': 'ab975b5c-f72d-4a8c-8b11-f916b880ed3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:f8:1c', 'vm-uuid': '15cd8cea-8506-43da-b3c6-69412acbae96'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:12:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:57 user nova-compute[74721]: INFO os_vif [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7')
Nov 02 23:12:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:12:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No VIF found with MAC fa:16:3e:e2:f8:1c, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:12:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updated VIF entry in instance network info cache for port ab975b5c-f72d-4a8c-8b11-f916b880ed3a. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:12:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating instance_info_cache with network_info: [{"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:12:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1c571bab-bb35-4266-ae15-976b8c682a57 req-62f5b31f-7a98-4d74-8f8d-c8884a7e4dcd service nova] Releasing lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:12:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] No waiting events found dispatching network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:12:59 user nova-compute[74721]: WARNING nova.compute.manager [req-516872d5-7959-4a1d-83bb-06bcaa6573f9 req-9bde1c94-bf35-41a9-b659-ca1b540b7462 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received unexpected event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a for instance with vm_state building and task_state spawning.
Nov 02 23:13:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:13:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Instance spawned successfully.
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] No waiting events found dispatching network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:13:01 user nova-compute[74721]: WARNING nova.compute.manager [req-106fd1ff-05bb-40ee-9bec-59601e91ef1b req-c49a0d22-15e4-40e8-b44f-298e12a53aac service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received unexpected event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a for instance with vm_state building and task_state spawning.
Nov 02 23:13:01 user nova-compute[74721]: INFO nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 02 23:13:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:13:01 user nova-compute[74721]: INFO nova.compute.manager [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Took 6.37 seconds to build instance.
Nov 02 23:13:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ad75da5e-cec1-48d3-8240-1eb28cda9ab0 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.504s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:14 user nova-compute[74721]: INFO nova.compute.manager [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Terminating instance
Nov 02 23:13:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-unplugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] No waiting events found dispatching network-vif-unplugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:13:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-99faece0-269c-4577-abf7-9a3a41fa3d57 req-b54aa237-f564-4b6c-ac83-3f8063a577ad service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-unplugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Instance destroyed successfully.
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.objects.instance [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lazy-loading 'resources' on Instance uuid 848014b4-7b18-46ac-aa18-d85ad52c6eef {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-400544873',display_name='tempest-ServersNegativeTestJSON-server-400544873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-400544873',id=18,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:04:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d3d78232483429696ed2b344053d838',ramdisk_id='',reservation_id='r-6a0oqsho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1186473108',owner_user_name='tempest-ServersNegativeTestJSON-1186473108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:04:12Z,user_data=None,user_id='9a9b1fd8951443c2b99bbd5097ae5a6d',uuid=848014b4-7b18-46ac-aa18-d85ad52c6eef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converting VIF {"id": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "address": "fa:16:3e:c5:1a:25", "network": {"id": "c3985980-5dff-4c49-98fb-b50b3676ba81", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-888387139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d3d78232483429696ed2b344053d838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4e9a84-4a", "ovs_interfaceid": "4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG os_vif [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b4e9a84-4a, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbc8db18-1037-43a4-95cb-900f7280c202) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:13:15 user nova-compute[74721]: INFO os_vif [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:1a:25,bridge_name='br-int',has_traffic_filtering=True,id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83,network=Network(c3985980-5dff-4c49-98fb-b50b3676ba81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4e9a84-4a')
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Deleting instance files /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef_del
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Deletion of /opt/stack/data/nova/instances/848014b4-7b18-46ac-aa18-d85ad52c6eef_del complete
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.compute.manager [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 02 23:13:15 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Took 0.67 seconds to deallocate network for instance.
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-ac8377ed-2e9e-4c7a-8be6-2fad4a46dee5 req-3335e0c4-8301-4ed4-907f-e03e9e7e2e59 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-deleted-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:13:15 user nova-compute[74721]: INFO nova.compute.manager [req-ac8377ed-2e9e-4c7a-8be6-2fad4a46dee5 req-3335e0c4-8301-4ed4-907f-e03e9e7e2e59 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Neutron deleted interface 4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83; detaching it from the instance and deleting it from the info cache
Nov 02 23:13:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-ac8377ed-2e9e-4c7a-8be6-2fad4a46dee5 req-3335e0c4-8301-4ed4-907f-e03e9e7e2e59 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-ac8377ed-2e9e-4c7a-8be6-2fad4a46dee5 req-3335e0c4-8301-4ed4-907f-e03e9e7e2e59 service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Detach interface failed, port_id=4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83, reason: Instance 848014b4-7b18-46ac-aa18-d85ad52c6eef could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:16 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Deleted allocations for instance 848014b4-7b18-46ac-aa18-d85ad52c6eef
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-65481462-a2d9-4d76-8143-80ef7019e18d tempest-ServersNegativeTestJSON-1186473108 tempest-ServersNegativeTestJSON-1186473108-project-member] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] Acquiring lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] Lock "848014b4-7b18-46ac-aa18-d85ad52c6eef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] No waiting events found dispatching network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:13:16 user nova-compute[74721]: WARNING nova.compute.manager [req-ef6c9a69-6c40-4994-abe2-768e83a7bdce req-bf757eec-dd22-4a6f-803f-f58fbf71e23e service nova] [instance: 848014b4-7b18-46ac-aa18-d85ad52c6eef] Received unexpected event network-vif-plugged-4b4e9a84-4a73-4d00-9c7d-4f7ae1769a83 for instance with vm_state deleted and task_state None.
Nov 02 23:13:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:22 user nova-compute[74721]: INFO nova.compute.manager [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Attaching volume 117a437b-3a7a-47ef-be80-199a6ec97be5 to /dev/vdb
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.utils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c851c-cb2a-4c60-830a-6cbfa58e52cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d614673-fc24-4daa-9b17-6e3deb2e6826]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ae136-99ff-48a7-88c6-93e87bde15a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef5df3-b850-4b65-a21d-9d59b6fb0459]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:13:22 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:13:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[851b6bc6-4355-4c8d-af31-b02d326db5ae]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG os_brick.utils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:13:22 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating existing volume attachment record: f03dc3cf-4176-4e1a-b103-cb3c1e699b0c {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:13:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:26 user nova-compute[74721]: INFO nova.compute.manager [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Detaching volume 6944f5ce-70a3-48c4-ab67-0d96ff294173
Nov 02 23:13:26 user nova-compute[74721]: INFO nova.virt.block_device [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attempting to driver detach volume 6944f5ce-70a3-48c4-ab67-0d96ff294173 from mountpoint /dev/vdb
Nov 02 23:13:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Attempting to detach device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:13:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:13:26 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:13:26 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:13:26 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:13:26 user nova-compute[74721]:   <serial>6944f5ce-70a3-48c4-ab67-0d96ff294173</serial>
Nov 02 23:13:26 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:13:26 user nova-compute[74721]: </disk>
Nov 02 23:13:26 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:13:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config.
Nov 02 23:13:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:13:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:13:26 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:13:26 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:13:26 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:13:26 user nova-compute[74721]:   <serial>6944f5ce-70a3-48c4-ab67-0d96ff294173</serial>
Nov 02 23:13:26 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:13:26 user nova-compute[74721]: </disk>
Nov 02 23:13:26 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:13:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:13:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:31 user nova-compute[74721]: INFO nova.compute.manager [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Detaching volume 1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:13:31 user nova-compute[74721]: INFO nova.virt.block_device [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Attempting to driver detach volume 1071000f-f1db-412a-acab-2c0dfdefd0b4 from mountpoint /dev/vdb
Nov 02 23:13:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Attempting to detach device vdb from instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:13:31 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:13:31 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:13:31 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:13:31 user nova-compute[74721]:   <serial>1071000f-f1db-412a-acab-2c0dfdefd0b4</serial>
Nov 02 23:13:31 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:13:31 user nova-compute[74721]: </disk>
Nov 02 23:13:31 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:13:31 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Successfully detached device vdb from instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f from the persistent domain config.
Nov 02 23:13:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:13:31 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:13:31 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:13:31 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:13:31 user nova-compute[74721]:   <serial>1071000f-f1db-412a-acab-2c0dfdefd0b4</serial>
Nov 02 23:13:31 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:13:31 user nova-compute[74721]: </disk>
Nov 02 23:13:31 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:13:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:13:32 user nova-compute[74721]: INFO nova.compute.manager [None req-9669ed3f-69bd-4ba3-b876-6894a20a5632 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Get console output
Nov 02 23:13:32 user nova-compute[74721]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 02 23:13:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:13:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:13:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:45 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 is timed out.
Nov 02 23:13:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config.
Nov 02 23:13:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtkIqzsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:13:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054917e-6deb-480a-8493-69a83e0309ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:13:47 user nova-compute[74721]: No targets found.
Nov 02 23:13:47 user nova-compute[74721]: iSNS:
Nov 02 23:13:47 user nova-compute[74721]: No targets found.
Nov 02 23:13:47 user nova-compute[74721]: STATIC:
Nov 02 23:13:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173
Nov 02 23:13:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:13:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:13:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:13:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:13:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:13:47 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:13:47 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:13:47 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:13:47 user nova-compute[74721]: FIRMWARE:
Nov 02 23:13:47 user nova-compute[74721]: No targets found.
Nov 02 23:13:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:13:47 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:13:47 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b13874e-2a7c-48ac-aa0e-0cc400de3e4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[08491bbe-7655-4f09-8704-f85f570b6fea]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 (non-flash)
Nov 02 23:13:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243752d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e228c88-be11-4181-a0fa-aca7c108d8bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b38b03b-ab93-4905-9975-7242d3e6198c]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99cc97f-5224-4402-92cd-bbb221f48e85]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77902bf-669d-4bc9-b83c-1adfad10b542]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8232b-abcc-485c-a858-80bf70c785a2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af47490-74b6-42a0-bebb-6bc1a760b27f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260]
Nov 02 23:13:47 user nova-compute[74721]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173, portal: 172.16.0.220,3260] successful.
Nov 02 23:13:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6944f5ce-70a3-48c4-ab67-0d96ff294173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f65b588-a6c2-4bc8-9138-bbb23f5f9817]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== disconnect_volume: return (375ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d647c37e-dae9-4047-a664-1ce0901c0c56 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.304s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:13:50 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:13:50 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.25864028930664GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b7645d21-5b03-4efb-9049-3178c9384108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 15cd8cea-8506-43da-b3c6-69412acbae96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:13:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:51 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f is timed out.
Nov 02 23:13:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Successfully detached device vdb from instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f from the live domain config.
Nov 02 23:13:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnTlJKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:13:52 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fbc804-6c7c-4b18-aa3c-7fe761f238e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:13:52 user nova-compute[74721]: No targets found.
Nov 02 23:13:52 user nova-compute[74721]: iSNS:
Nov 02 23:13:52 user nova-compute[74721]: No targets found.
Nov 02 23:13:52 user nova-compute[74721]: STATIC:
Nov 02 23:13:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4
Nov 02 23:13:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:13:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:13:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:13:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:13:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:13:52 user nova-compute[74721]: FIRMWARE:
Nov 02 23:13:52 user nova-compute[74721]: No targets found.
Nov 02 23:13:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:13:52 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:13:52 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a51add-2414-474f-8e57-0b3593d255f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f180f7-5f0f-4a2a-9568-22633cc3d0fc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:13:52 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:13:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 (non-flash)
Nov 02 23:13:52 user nova-compute[74721]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:13:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24733490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[04956083-1d08-4f4f-94d2-58d746191f71]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bfea9a-d2f4-4f83-af4f-ddca785624c0]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ca5d88-4ccc-4d6d-b39e-2c3a6ba95981]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd1f55-b66d-45ec-a25e-abe53668c52d]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24789b41-1f39-4b63-9084-00c016c4a742]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a6e8b-a0b5-4807-8dbf-8963abcc66f7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260]
Nov 02 23:13:52 user nova-compute[74721]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4, portal: 172.16.0.220,3260] successful.
Nov 02 23:13:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1071000f-f1db-412a-acab-2c0dfdefd0b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d520faef-a50d-462e-9e78-6cd58c44cd34]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] <== disconnect_volume: return (309ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:13:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:13:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'flavor' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:13:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-693b3bef-5b7c-4cf5-981e-4f5c12d317ff tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:13:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:07 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[245157a0-cf40-4fd2-a790-f861aef59cd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:14:07 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f939d39a-35e9-44a1-bbed-4e8c550ed63c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5] added
Nov 02 23:14:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1bbf65-cfce-4c02-bf6d-8e5ccd203045]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f583e88a-3411-40b6-b716-5a03f28c17a3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHvrbfCe {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHvrbfCe" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e27d16e-a579-4d16-b502-d2b829acd245]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHvrbfCe'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb020c1c-8428-4dee-a012-ab3b690dfb0d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c236691d-4679-4998-b47c-1d1571b2acf3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e011cf-9fe4-4687-9f6b-d5e40bea5d2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]
Nov 02 23:14:08 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78a9ee-76c1-4e46-a4ab-e4ed719df7f0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9aa6b-ad41-41f6-8fa1-ca5cfb6c814a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0f638e-4797-4cc1-a4ec-ce03a47376eb]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26635346236313661', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635346236313661', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:14:09 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:09 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:14:09 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:09 user nova-compute[74721]:   <serial>117a437b-3a7a-47ef-be80-199a6ec97be5</serial>
Nov 02 23:14:09 user nova-compute[74721]: </disk>
Nov 02 23:14:09 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No VIF found with MAC fa:16:3e:ac:50:65, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:14:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0a478c3c-9e38-44eb-b69e-0054288692eb tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.168s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-changed-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Refreshing instance network info cache due to event network-changed-4dd62ad6-608e-4bea-8b3a-0e30c0d91688. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] Acquiring lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] Acquired lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Refreshing network info cache for port 4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updated VIF entry in instance network info cache for port 4dd62ad6-608e-4bea-8b3a-0e30c0d91688. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updating instance_info_cache with network_info: [{"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9bbde54b-fdc6-42c8-b096-4ae46d2fb7ea req-6f60a1f5-81f9-4ef5-b45f-6687b49d5136 service nova] Releasing lock "refresh_cache-b7645d21-5b03-4efb-9049-3178c9384108" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:21 user nova-compute[74721]: INFO nova.compute.manager [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Terminating instance
Nov 02 23:14:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.compute.claims [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Claim successful on node user
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-unplugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] No waiting events found dispatching network-vif-unplugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-a87c2fe4-44d0-485d-9490-606ede113c67 req-6cba8dd7-8179-442a-9060-854c70230484 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-unplugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Instance destroyed successfully.
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lazy-loading 'resources' on Instance uuid 3f4c55ff-6ab7-410d-b149-3c51c69c084f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1085534064',display_name='tempest-TestServerVolumeAttachmentScenario-server-1085534064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1085534064',id=24,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJw7BfEt3QtMXa4fdStBIuQLENLBd85yaT/Rm0ZeUNRMWenWBvX469REuYfCMjHCSWRpAAmlfkbcHqqbKpBQAMFy2n0flYemt9FClhQi4yvc3t33SWlXeipmr3XNwyarw==',key_name='tempest-keypair-71191032',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa27a912c4b4bfa84f24b2105bbb1ea',ramdisk_id='',reservation_id='r-pt08t1sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1063835074',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1063835074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb654019bab4504a67a9fe16c032fa5',uuid=3f4c55ff-6ab7-410d-b149-3c51c69c084f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converting VIF {"id": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "address": "fa:16:3e:b7:d3:45", "network": {"id": "dfb41d21-d08e-485f-9785-9ef0b298d1de", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-26337327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa27a912c4b4bfa84f24b2105bbb1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee17fe0-f1", "ovs_interfaceid": "0ee17fe0-f1dc-4771-94eb-9380e4e7056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG os_vif [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee17fe0-f1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.policy [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8116c488ed184fd2ace8fdbe0845d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca645902e8740fd909d3d90bbc62b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f235ffe-4849-4a53-b52d-6be6b0600101) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:22 user nova-compute[74721]: INFO os_vif [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d3:45,bridge_name='br-int',has_traffic_filtering=True,id=0ee17fe0-f1dc-4771-94eb-9380e4e7056c,network=Network(dfb41d21-d08e-485f-9785-9ef0b298d1de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee17fe0-f1')
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Deleting instance files /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f_del
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Deletion of /opt/stack/data/nova/instances/3f4c55ff-6ab7-410d-b149-3c51c69c084f_del complete
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Creating image(s)
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:22 user nova-compute[74721]: INFO nova.compute.manager [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 02 23:14:22 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:14:22 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.229s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk 1073741824" returned: 0 in 0.058s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Successfully created port: d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Cannot resize image /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Ensure instance console log exists: /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:24 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Took 1.17 seconds to deallocate network for instance.
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-e1c871ae-8d9c-43cd-bb34-26dec19faf1c req-b2246749-c0df-4594-80fb-d2c863e3bb61 service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-deleted-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] Acquiring lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] No waiting events found dispatching network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:24 user nova-compute[74721]: WARNING nova.compute.manager [req-8cdb85a9-586c-4a0b-a979-caaad8547cf8 req-96f0d84c-af5e-4f04-9a99-c9563edaa8bc service nova] [instance: 3f4c55ff-6ab7-410d-b149-3c51c69c084f] Received unexpected event network-vif-plugged-0ee17fe0-f1dc-4771-94eb-9380e4e7056c for instance with vm_state deleted and task_state None.
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: INFO nova.compute.manager [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attaching volume cfdc6a3a-6a92-4b9d-abe9-7b780730097c to /dev/vdb
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.utils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d7f13-3c14-461a-bba6-f3c5c89165d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:24 user nova-compute[74721]: INFO nova.compute.manager [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Attaching volume 979f7c40-2ffa-427c-9aab-63aa226787c5 to /dev/vdb
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2e97e-9da4-4de3-a537-69726032c5c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9910a-4118-4d8b-b961-1f1c98108095]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b5343-514a-44ce-b4de-f2ab53add4a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.utils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Successfully updated port: d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:24 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842a319-9d98-4364-829d-dbfec045c87a]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.utils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating existing volume attachment record: 5c842cb7-2499-42b0-8da4-cab109506486 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5d19c-cfd2-4e6e-a11a-ef3336844775]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing instance network info cache due to event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e177b95-9ecc-4081-b838-a41aa8b47d93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b30c6f-1184-408c-b8fb-dcdaceaee0c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a9a9a-a343-4a27-ac22-2ece6a732c2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:14:24 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Deleted allocations for instance 3f4c55ff-6ab7-410d-b149-3c51c69c084f
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:24 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e09ac4-5163-4705-8276-3ffadab95384]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG os_brick.utils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updating existing volume attachment record: 3fbd355f-7719-4f06-af10-d677af4883f6 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:14:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6afad100-472f-4f3e-9b04-bf95f60d6816 tempest-TestServerVolumeAttachmentScenario-1063835074 tempest-TestServerVolumeAttachmentScenario-1063835074-project-member] Lock "3f4c55ff-6ab7-410d-b149-3c51c69c084f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.053s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance network_info: |[{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start _get_guest_xml network_info=[{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:14:25 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:25 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMALd36Qxsw8QMp5xI5aCMKDyO1mL9mLSl51t6QQ4wB6n9ydImx6hZXuP8j7NKK08DXKswKD5OXgkt9MnbEeeG7ochwLXWxPHwmkZaQJy6LFsFIcCzPnoxjrqNw7AC28SA==',key_name='tempest-keypair-688781644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_devices' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:14:25 user nova-compute[74721]:   <uuid>ee1c3ce6-0281-46ae-98c3-df163d075533</uuid>
Nov 02 23:14:25 user nova-compute[74721]:   <name>instance-00000021</name>
Nov 02 23:14:25 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:14:25 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:14:25 user nova-compute[74721]:   <metadata>
Nov 02 23:14:25 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:14:25 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-774356443</nova:name>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:14:25</nova:creationTime>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:14:25 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:14:25 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:owner>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:user uuid="8116c488ed184fd2ace8fdbe0845d033">tempest-AttachVolumeShelveTestJSON-110193585-project-member</nova:user>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:project uuid="eca645902e8740fd909d3d90bbc62b01">tempest-AttachVolumeShelveTestJSON-110193585</nova:project>
Nov 02 23:14:25 user nova-compute[74721]:       </nova:owner>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:14:25 user nova-compute[74721]:       <nova:ports>
Nov 02 23:14:25 user nova-compute[74721]:         <nova:port uuid="d2bd5cff-877a-4067-a204-8ab9bf8bf6a9">
Nov 02 23:14:25 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 23:14:25 user nova-compute[74721]:         </nova:port>
Nov 02 23:14:25 user nova-compute[74721]:       </nova:ports>
Nov 02 23:14:25 user nova-compute[74721]:     </nova:instance>
Nov 02 23:14:25 user nova-compute[74721]:   </metadata>
Nov 02 23:14:25 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:14:25 user nova-compute[74721]:     <system>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="serial">ee1c3ce6-0281-46ae-98c3-df163d075533</entry>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="uuid">ee1c3ce6-0281-46ae-98c3-df163d075533</entry>
Nov 02 23:14:25 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:14:25 user nova-compute[74721]:     </system>
Nov 02 23:14:25 user nova-compute[74721]:   </sysinfo>
Nov 02 23:14:25 user nova-compute[74721]:   <os>
Nov 02 23:14:25 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:14:25 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:14:25 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:14:25 user nova-compute[74721]:   </os>
Nov 02 23:14:25 user nova-compute[74721]:   <features>
Nov 02 23:14:25 user nova-compute[74721]:     <acpi/>
Nov 02 23:14:25 user nova-compute[74721]:     <apic/>
Nov 02 23:14:25 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:14:25 user nova-compute[74721]:   </features>
Nov 02 23:14:25 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:14:25 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:14:25 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:14:25 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:14:25 user nova-compute[74721]:   </clock>
Nov 02 23:14:25 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:14:25 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:14:25 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:14:25 user nova-compute[74721]:   </cpu>
Nov 02 23:14:25 user nova-compute[74721]:   <devices>
Nov 02 23:14:25 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:14:25 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:14:25 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk"/>
Nov 02 23:14:25 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:14:25 user nova-compute[74721]:     </disk>
Nov 02 23:14:25 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:14:25 user nova-compute[74721]:       <mac address="fa:16:3e:f9:ef:9f"/>
Nov 02 23:14:25 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:25 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:14:25 user nova-compute[74721]:       <target dev="tapd2bd5cff-87"/>
Nov 02 23:14:25 user nova-compute[74721]:     </interface>
Nov 02 23:14:25 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:14:25 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/console.log" append="off"/>
Nov 02 23:14:25 user nova-compute[74721]:     </serial>
Nov 02 23:14:25 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:14:25 user nova-compute[74721]:     <video>
Nov 02 23:14:25 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:25 user nova-compute[74721]:     </video>
Nov 02 23:14:25 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:14:25 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:14:25 user nova-compute[74721]:     </rng>
Nov 02 23:14:25 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:14:25 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:14:25 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:14:25 user nova-compute[74721]:     </memballoon>
Nov 02 23:14:25 user nova-compute[74721]:   </devices>
Nov 02 23:14:25 user nova-compute[74721]: </domain>
Nov 02 23:14:25 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMALd36Qxsw8QMp5xI5aCMKDyO1mL9mLSl51t6QQ4wB6n9ydImx6hZXuP8j7NKK08DXKswKD5OXgkt9MnbEeeG7ochwLXWxPHwmkZaQJy6LFsFIcCzPnoxjrqNw7AC28SA==',key_name='tempest-keypair-688781644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG os_vif [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbae41ec-78ae-5bd7-84a0-ac5f3ae1d401', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2bd5cff-87, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2bd5cff-87, col_values=(('qos', UUID('9df98265-01bb-4699-8142-19e7937c916c')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2bd5cff-87, col_values=(('external_ids', {'iface-id': 'd2bd5cff-877a-4067-a204-8ab9bf8bf6a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ef:9f', 'vm-uuid': 'ee1c3ce6-0281-46ae-98c3-df163d075533'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:25 user nova-compute[74721]: INFO os_vif [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87')
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No VIF found with MAC fa:16:3e:f9:ef:9f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updated VIF entry in instance network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG nova.network.neutron [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d33f3f4-cb1c-4aa7-8ad9-0d431391a1b2 req-16ae8b20-4dcb-4825-8786-7e3f5a25ef8a service nova] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing instance network info cache due to event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:26 user nova-compute[74721]: DEBUG nova.network.neutron [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated VIF entry in instance network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-68dd9a7e-bdc6-4455-b436-a4f76681047f req-221f0615-57fa-4c36-901d-7a2d03c5d15e service nova] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:28 user nova-compute[74721]: WARNING nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state building and task_state spawning.
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:28 user nova-compute[74721]: WARNING nova.compute.manager [req-f47c27fa-d1a7-483f-8896-73553f1c34b4 req-4f28b7e0-142d-4a5e-b3fa-27d95878e904 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state building and task_state spawning.
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing instance network info cache due to event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:28 user nova-compute[74721]: INFO nova.compute.manager [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Unrescuing
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated VIF entry in instance network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.network.neutron [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f77e95db-7379-4e2f-a18d-1b965db70303 req-18b35352-b96c-4306-9def-bcadd6e1c63c service nova] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:14:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance spawned successfully.
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:14:29 user nova-compute[74721]: INFO nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'flavor' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:29 user nova-compute[74721]: INFO nova.compute.manager [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Took 8.06 seconds to build instance.
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4e73d4f6-7fc4-4695-9fbf-a48409d7b659 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.224s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance destroyed successfully.
Nov 02 23:14:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:30 user nova-compute[74721]: WARNING nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:14:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:30 user nova-compute[74721]: WARNING nova.compute.manager [req-cf93e60c-1d3e-456a-aba7-7352ff975a16 req-56047886-ffd5-46cf-afb5-df04682550d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:14:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:31 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:14:31 user nova-compute[74721]: INFO nova.compute.claims [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Claim successful on node user
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:32 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:14:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:14:32 user nova-compute[74721]: INFO nova.virt.block_device [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Booting with volume ecbdff50-f861-4bf2-a69a-7366d21b51a0 at /dev/vda
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.policy [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ace8a1614dbb40f1abbcec0433775de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a24963e0da47008a77678475eae00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1316e7e-359f-4dd4-82f4-73201a3ddf8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676ae46-52bd-4e5c-8d6b-e275e5ba60e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[39906ddd-c5de-43ce-be88-6fbb7d1d0209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beff01d-f8dc-4218-9718-f379c9cbd3f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:32 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:14:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[752484d4-aa76-4bb3-b9b2-172a87363fb8]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:32 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating existing volume attachment record: 1095340a-7298-4b27-8e5f-989adefe61c0 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:33 user nova-compute[74721]: WARNING nova.compute.manager [req-300531ae-bb13-4a85-a2d2-0d040013a378 req-2b8b15b0-8214-4b78-98d1-4b7ce82c1281 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:33 user nova-compute[74721]: INFO nova.compute.manager [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Terminating instance
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-99ea5b3c-489f-4f34-ae28-2d2030e99b2c req-042ba91a-3c98-49f7-b7d1-346303c4ad40 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-unplugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Instance destroyed successfully.
Nov 02 23:14:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'resources' on Instance uuid 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1046938844',display_name='tempest-ServerActionsTestOtherA-server-1046938844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1046938844',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-wp7unuei',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=4043343b-caf6-4c8d-bdfb-cbed139e2ba6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "d14b80b3-c95a-4f20-88e2-716939a87eab", "address": "fa:16:3e:32:de:6e", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b80b3-c9", "ovs_interfaceid": "d14b80b3-c95a-4f20-88e2-716939a87eab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_vif [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Successfully created port: 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd14b80b3-c9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bfeb603-96b1-45ce-8bf2-598bd6653fb5) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:34 user nova-compute[74721]: INFO os_vif [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:de:6e,bridge_name='br-int',has_traffic_filtering=True,id=d14b80b3-c95a-4f20-88e2-716939a87eab,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b80b3-c9')
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFefYmBy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1dd90d-84c9-4c47-b468-1a090722d890]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:14:34 user nova-compute[74721]: No targets found.
Nov 02 23:14:34 user nova-compute[74721]: iSNS:
Nov 02 23:14:34 user nova-compute[74721]: No targets found.
Nov 02 23:14:34 user nova-compute[74721]: STATIC:
Nov 02 23:14:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:14:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:14:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:14:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44
Nov 02 23:14:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:14:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:14:34 user nova-compute[74721]: FIRMWARE:
Nov 02 23:14:34 user nova-compute[74721]: No targets found.
Nov 02 23:14:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:14:34 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:14:34 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae687f8-d9c3-4500-ab55-f6352d663ed0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f18450-572e-4f85-8a51-547d545c7923]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:34 user nova-compute[74721]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 (non-flash)
Nov 02 23:14:34 user nova-compute[74721]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c3ab520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e329cf81-0e56-4d1e-9443-7b7a9174a002]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61880f22-afeb-4306-ab14-99a147d24582]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc690a9-2843-49ce-90a0-49d40ea6e40e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967fc47-e27d-498e-b2f3-145c7174814d]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_467e1edd', '/dev/disk/by-id/scsi-26537346435326335', '/dev/disk/by-id/scsi-1SCST_BIO467e1edd-e74d52c52fadb058') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4515c35b-b4ab-401e-9339-57bb3d159802]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5666e1ee-06a8-42b8-b313-222b587bb481]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6933942e-cd9b-4ad5-afcc-84ca562a5eac]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260]
Nov 02 23:14:34 user nova-compute[74721]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba16bd44-d914-40b1-9af5-3c95daf76a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cacc3e-bfdc-4b9f-99df-a64d4ce21084]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] <== disconnect_volume: return (455ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:14:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Deleting instance files /opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6_del
Nov 02 23:14:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Deletion of /opt/stack/data/nova/instances/4043343b-caf6-4c8d-bdfb-cbed139e2ba6_del complete
Nov 02 23:14:34 user nova-compute[74721]: INFO nova.compute.manager [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 02 23:14:34 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:14:34 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Successfully updated port: 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:35 user nova-compute[74721]: WARNING nova.compute.manager [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing instance network info cache due to event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance network_info: |[{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.network.neutron [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] Acquiring lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] No waiting events found dispatching network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:35 user nova-compute[74721]: WARNING nova.compute.manager [req-54f6f323-ad97-4382-8916-eab7a7dc2d03 req-40ab4fe7-ad93-414e-afb8-8c36049329c6 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received unexpected event network-vif-plugged-d14b80b3-c95a-4f20-88e2-716939a87eab for instance with vm_state active and task_state deleting.
Nov 02 23:14:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-df6732ed-0985-4122-bd7c-2ee4eeceee9d tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:36 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Took 1.34 seconds to deallocate network for instance.
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d192e7c-3d17-4210-ae11-5226441a110a req-76476344-8bd7-49fa-9e97-1031dcae4934 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Received event network-vif-deleted-d14b80b3-c95a-4f20-88e2-716939a87eab {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:36 user nova-compute[74721]: INFO nova.compute.manager [req-9d192e7c-3d17-4210-ae11-5226441a110a req-76476344-8bd7-49fa-9e97-1031dcae4934 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Neutron deleted interface d14b80b3-c95a-4f20-88e2-716939a87eab; detaching it from the instance and deleting it from the info cache
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-9d192e7c-3d17-4210-ae11-5226441a110a req-76476344-8bd7-49fa-9e97-1031dcae4934 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d192e7c-3d17-4210-ae11-5226441a110a req-76476344-8bd7-49fa-9e97-1031dcae4934 service nova] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Detach interface failed, port_id=d14b80b3-c95a-4f20-88e2-716939a87eab, reason: Instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updated VIF entry in instance network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG nova.network.neutron [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-386de9c2-601b-484b-8ce6-17701ead24c4 req-2fbe16fc-3fb4-4986-957d-30418407afe2 service nova] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:38 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:39 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:14:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-changed-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Refreshing instance network info cache due to event network-changed-ab975b5c-f72d-4a8c-8b11-f916b880ed3a. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] Acquiring lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] Acquired lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Refreshing network info cache for port ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updated VIF entry in instance network info cache for port ab975b5c-f72d-4a8c-8b11-f916b880ed3a. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG nova.network.neutron [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating instance_info_cache with network_info: [{"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3b21e3c6-00be-41c8-a5dc-932c9705bb9a req-db328cc6-1800-448f-a4b5-f32a4bcbee0f service nova] Releasing lock "refresh_cache-15cd8cea-8506-43da-b3c6-69412acbae96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:47 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOnCFGIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:48 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:48 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:48 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cadc737-012c-4e04-8768-d08e55f3072a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:14:48 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62288cf-1f8d-4cb3-9771-b5865aea6fdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5] added
Nov 02 23:14:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c372a-cce8-4020-90ae-e8b2ac48b176]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1a5b9-ccb3-42b5-82c3-db99fcc329c5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOnCFGIb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOnCFGIb" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[302d402f-1e4d-4e1e-8e01-984248090952]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOnCFGIb'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5e3ccb-3fe7-4bf0-b29f-84f11c7fa267]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1195e-0a69-477a-9e70-82645641d144]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:48 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:48 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283f8d8-7b6d-4c07-8337-64ccb3ef92a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260]
Nov 02 23:14:49 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11547e2-a73e-42fe-8ba4-59146e731657]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dd8f2a-b6b3-44cf-bf37-efe6281151f4]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:49 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:49 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1bf140-39b8-43e3-99a0-b9c48b6a6c03]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOnCFGIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:49 user nova-compute[74721]: INFO nova.compute.manager [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Rebooting instance
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEVNAHnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:49 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG nova.objects.instance [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Ignoring supplied device name: /dev/vdb
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:50 user nova-compute[74721]: INFO nova.compute.manager [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Attaching volume 8a0726c6-2efa-4aed-a2d5-9127e98e5000 to /dev/vdb
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23832643362386464', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832643362386464', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.843s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:50 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:50 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: INFO nova.compute.manager [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Took 14.17 seconds to detach 1 volumes for instance.
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28636e-0546-4eac-87e3-c7f9db465325]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.utils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:14:50 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 4043343b-caf6-4c8d-bdfb-cbed139e2ba6] Deleting volume: ba16bd44-d914-40b1-9af5-3c95daf76a44 {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29efc528-c747-4b2b-bad5-846bcc322c82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a9a1e1-1e32-48ea-a1a8-2e90a221bb93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c] added
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9020817-89d5-4004-bf62-d1ab305c009c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:14:50 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:50 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:14:50 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:50 user nova-compute[74721]:   <serial>979f7c40-2ffa-427c-9aab-63aa226787c5</serial>
Nov 02 23:14:50 user nova-compute[74721]: </disk>
Nov 02 23:14:50 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422c648-f880-4672-b7fb-1add84d92c8b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeced6a-af4d-4ca6-be99-a54092f206b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed431487-5e5d-44de-82f0-a46df5df11eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb8104-5d8b-4956-ba14-f8463e20d091]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEVNAHnO {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:14:50 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c570ea5b-81d7-4fa6-884f-13d86e144618]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEVNAHnO" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f71c0b-c14e-497b-8048-89e454eead92]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jEVNAHnO'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.utils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== get_connector_properties: return (259ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating existing volume attachment record: 8afec487-635d-41de-8050-c739cb53f551 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee655d-7be8-4175-b5e5-0718988b81b3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade61477-1275-49a4-9dd6-7cc5bc9141f6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb360e6-f2a7-42aa-a071-f2a7c3b31f3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260]
Nov 02 23:14:50 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[803bcc9a-f072-40f3-be71-712cf716cabc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8eacc2-c936-428d-b8ad-463b914187a6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:50 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.528s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[900877c0-b920-4dd9-9b3c-a93ebbee0471]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEVNAHnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:dd:df:8d, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e0d6d492-7310-433f-8c0c-9fd546ee91ea tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.519s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:51 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Deleted allocations for instance 4043343b-caf6-4c8d-bdfb-cbed139e2ba6
Nov 02 23:14:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-99c7c912-51f9-4391-ae3b-79a33b1e3627 tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "4043343b-caf6-4c8d-bdfb-cbed139e2ba6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.483s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:51 user nova-compute[74721]: WARNING nova.compute.manager [req-32785929-1706-428c-8048-ac78437e57a2 req-09d8a240-e72f-4f47-b57d-61109ceb2ae9 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== connect_volume: return (2432ms) {'type': 'block', 'scsi_wwn': '23134323230626438', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134323230626438', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:14:51 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:51 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:14:51 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:51 user nova-compute[74721]:   <serial>cfdc6a3a-6a92-4b9d-abe9-7b780730097c</serial>
Nov 02 23:14:51 user nova-compute[74721]: </disk>
Nov 02 23:14:51 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:52 user nova-compute[74721]: INFO nova.compute.manager [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Detaching volume 979f7c40-2ffa-427c-9aab-63aa226787c5
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: INFO nova.virt.block_device [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Attempting to driver detach volume 979f7c40-2ffa-427c-9aab-63aa226787c5 from mountpoint /dev/vdb
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Attempting to detach device vdb from instance b7645d21-5b03-4efb-9049-3178c9384108 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:14:52 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:52 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:14:52 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:52 user nova-compute[74721]:   <serial>979f7c40-2ffa-427c-9aab-63aa226787c5</serial>
Nov 02 23:14:52 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:14:52 user nova-compute[74721]: </disk>
Nov 02 23:14:52 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:14:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance b7645d21-5b03-4efb-9049-3178c9384108 from the persistent domain config.
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7645d21-5b03-4efb-9049-3178c9384108 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:14:52 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:52 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:14:52 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:52 user nova-compute[74721]:   <serial>979f7c40-2ffa-427c-9aab-63aa226787c5</serial>
Nov 02 23:14:52 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:14:52 user nova-compute[74721]: </disk>
Nov 02 23:14:52 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:14:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance destroyed successfully.
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.objects.instance [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'resources' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:52 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.24542999267578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:14:51Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08acdf3d-6e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=873f8886-2083-475d-947a-a4aef8016c0f) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No VIF found with MAC fa:16:3e:ac:49:ba, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:14:52 user nova-compute[74721]: INFO os_vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e')
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:52 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc028cec-1c46-45ca-bab8-77d52f9fdef7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:14:52 user nova-compute[74721]: No targets found.
Nov 02 23:14:52 user nova-compute[74721]: iSNS:
Nov 02 23:14:52 user nova-compute[74721]: No targets found.
Nov 02 23:14:52 user nova-compute[74721]: STATIC:
Nov 02 23:14:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:14:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:14:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:14:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c
Nov 02 23:14:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:14:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:14:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5
Nov 02 23:14:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:14:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:14:52 user nova-compute[74721]: FIRMWARE:
Nov 02 23:14:52 user nova-compute[74721]: No targets found.
Nov 02 23:14:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:14:52 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:14:52 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce9068-7532-49ba-8582-fa26de7af094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8cc19-23b7-4ea0-a120-440d785372f0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:52 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:52 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:52 user nova-compute[74721]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:52 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf04776dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c0f556-0bbc-420f-9abb-a135212af3b9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3f539868-3357-4719-a715-39ab06bf8898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b7645d21-5b03-4efb-9049-3178c9384108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 15cd8cea-8506-43da-b3c6-69412acbae96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ee1c3ce6-0281-46ae-98c3-df163d075533 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance d043208f-7d0f-4017-8e4b-f3c28de3a88f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[13003d4a-4b0e-40df-983d-a57deb2316cc]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-66b5e817-9765-4e45-b740-baafc6b75ce4 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.508s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c40302-5480-48ff-b0ad-83d5835f242d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:14:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd2c6d-2c93-4548-8b71-d672b87eaf3e]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159608b-f72a-4d87-b1b2-35516839e9d7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64f3ed-e32c-478c-b79b-2b55605e6ca8]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]
Nov 02 23:14:53 user nova-compute[74721]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db2910c-e1c9-47d3-87d5-1b0c61d787ec]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== disconnect_volume: return (365ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start _get_guest_xml network_info=[{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3fdfb82a-ec4f-4bbc-8c4c-5585595dd577,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '3fdfb82a-ec4f-4bbc-8c4c-5585595dd577'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': 'f03dc3cf-4176-4e1a-b103-cb3c1e699b0c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '185ac37f-d13e-4209-a195-a08acc8321c4', 'attached_at': '', 'detached_at': '', 'volume_id': '117a437b-3a7a-47ef-be80-199a6ec97be5', 'serial': '117a437b-3a7a-47ef-be80-199a6ec97be5'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:14:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3fdfb82a-ec4f-4bbc-8c4c-5585595dd577,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'vcpu_model' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.objects.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Object Instance<185ac37f-d13e-4209-a195-a08acc8321c4> lazy-loaded attributes: resources,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:53 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:53 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:53 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc0156b-610a-48b9-994f-3b9b0c69768a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:14:53 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a217ff-391a-4331-871f-001cdc415fa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5] added
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4f52dc-b1a9-46c6-8423-98cb321e9dd3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437bde7-de9d-43d7-8e83-b8dabad075f2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHvrbfCe {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHvrbfCe" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[190de842-de8f-4de7-968d-adea09e345ff]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHvrbfCe'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5343ea17-77c4-4974-a8de-f8d350b2cfe7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71bd2a-d760-48be-af7f-b8ca581bef9b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f4f07-bcfb-4b8d-a8c6-4bbb8cf531ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]
Nov 02 23:14:53 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9923305-3c3d-4dc5-b7d1-115fdb8ecd31]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f757525a-1f86-4ed7-9e5d-3f0a5eedf3e4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:53 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f54e6-9b03-46ee-b0db-491b209911b8]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:53 user nova-compute[74721]: WARNING nova.compute.manager [req-dc07ff3e-9f96-49ec-88a4-7cce83d26e76 req-3eaa323f-49aa-4771-b9fd-5fcc3399ebca service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 23:14:54 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26635346236313661', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635346236313661', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:14:51Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.objects.instance [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'pci_devices' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.objects.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Object Instance<185ac37f-d13e-4209-a195-a08acc8321c4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:14:54 user nova-compute[74721]:   <uuid>185ac37f-d13e-4209-a195-a08acc8321c4</uuid>
Nov 02 23:14:54 user nova-compute[74721]:   <name>instance-0000001e</name>
Nov 02 23:14:54 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:14:54 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:14:54 user nova-compute[74721]:   <metadata>
Nov 02 23:14:54 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:14:54 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:name>tempest-TestMinimumBasicScenario-server-646288978</nova:name>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:14:53</nova:creationTime>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:14:54 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:14:54 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:owner>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:user uuid="2dc6f5e5ea0d4089998a6b8bff41c488">tempest-TestMinimumBasicScenario-493864842-project-member</nova:user>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:project uuid="7e6216758d9b4e8abdb1840710239900">tempest-TestMinimumBasicScenario-493864842</nova:project>
Nov 02 23:14:54 user nova-compute[74721]:       </nova:owner>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:root type="image" uuid="3fdfb82a-ec4f-4bbc-8c4c-5585595dd577"/>
Nov 02 23:14:54 user nova-compute[74721]:       <nova:ports>
Nov 02 23:14:54 user nova-compute[74721]:         <nova:port uuid="08acdf3d-6e0a-4b6f-9b4c-88731e6c0468">
Nov 02 23:14:54 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 23:14:54 user nova-compute[74721]:         </nova:port>
Nov 02 23:14:54 user nova-compute[74721]:       </nova:ports>
Nov 02 23:14:54 user nova-compute[74721]:     </nova:instance>
Nov 02 23:14:54 user nova-compute[74721]:   </metadata>
Nov 02 23:14:54 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:14:54 user nova-compute[74721]:     <system>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="serial">185ac37f-d13e-4209-a195-a08acc8321c4</entry>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="uuid">185ac37f-d13e-4209-a195-a08acc8321c4</entry>
Nov 02 23:14:54 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:14:54 user nova-compute[74721]:     </system>
Nov 02 23:14:54 user nova-compute[74721]:   </sysinfo>
Nov 02 23:14:54 user nova-compute[74721]:   <os>
Nov 02 23:14:54 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:14:54 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:14:54 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:14:54 user nova-compute[74721]:   </os>
Nov 02 23:14:54 user nova-compute[74721]:   <features>
Nov 02 23:14:54 user nova-compute[74721]:     <acpi/>
Nov 02 23:14:54 user nova-compute[74721]:     <apic/>
Nov 02 23:14:54 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:14:54 user nova-compute[74721]:   </features>
Nov 02 23:14:54 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:14:54 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:14:54 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:14:54 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:14:54 user nova-compute[74721]:   </clock>
Nov 02 23:14:54 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:14:54 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:14:54 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:14:54 user nova-compute[74721]:   </cpu>
Nov 02 23:14:54 user nova-compute[74721]:   <devices>
Nov 02 23:14:54 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:14:54 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:14:54 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk"/>
Nov 02 23:14:54 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:14:54 user nova-compute[74721]:     </disk>
Nov 02 23:14:54 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:14:54 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:54 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:14:54 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:14:54 user nova-compute[74721]:       <serial>117a437b-3a7a-47ef-be80-199a6ec97be5</serial>
Nov 02 23:14:54 user nova-compute[74721]:     </disk>
Nov 02 23:14:54 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:14:54 user nova-compute[74721]:       <mac address="fa:16:3e:ac:50:65"/>
Nov 02 23:14:54 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:54 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:14:54 user nova-compute[74721]:       <target dev="tap08acdf3d-6e"/>
Nov 02 23:14:54 user nova-compute[74721]:     </interface>
Nov 02 23:14:54 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:14:54 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/console.log" append="off"/>
Nov 02 23:14:54 user nova-compute[74721]:     </serial>
Nov 02 23:14:54 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:14:54 user nova-compute[74721]:     <video>
Nov 02 23:14:54 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:54 user nova-compute[74721]:     </video>
Nov 02 23:14:54 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:14:54 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:14:54 user nova-compute[74721]:     </rng>
Nov 02 23:14:54 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:14:54 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:14:54 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:14:54 user nova-compute[74721]:     </memballoon>
Nov 02 23:14:54 user nova-compute[74721]:   </devices>
Nov 02 23:14:54 user nova-compute[74721]: </domain>
Nov 02 23:14:54 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.objects.instance [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'trusted_certs' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.objects.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Object Instance<185ac37f-d13e-4209-a195-a08acc8321c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:55 user nova-compute[74721]: INFO nova.compute.manager [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Detaching volume cfdc6a3a-6a92-4b9d-abe9-7b780730097c
Nov 02 23:14:55 user nova-compute[74721]: INFO nova.virt.block_device [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attempting to driver detach volume cfdc6a3a-6a92-4b9d-abe9-7b780730097c from mountpoint /dev/vdb
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 --force-share --output=json" returned: 0 in 0.480s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Attempting to detach device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:14:55 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:55 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:14:55 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:55 user nova-compute[74721]:   <serial>cfdc6a3a-6a92-4b9d-abe9-7b780730097c</serial>
Nov 02 23:14:55 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:14:55 user nova-compute[74721]: </disk>
Nov 02 23:14:55 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:14:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config.
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:14:55 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:55 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:14:55 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:14:55 user nova-compute[74721]:   <serial>cfdc6a3a-6a92-4b9d-abe9-7b780730097c</serial>
Nov 02 23:14:55 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:14:55 user nova-compute[74721]: </disk>
Nov 02 23:14:55 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Cannot resize image /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.objects.instance [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'migration_context' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.objects.base [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Object Instance<185ac37f-d13e-4209-a195-a08acc8321c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:14:51Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG os_vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4e7867e-b994-5a17-b9e9-460ee4b03243', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08acdf3d-6e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08acdf3d-6e, col_values=(('qos', UUID('d49b51a3-9a9c-4511-bd5a-61eb36ff2b27')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08acdf3d-6e, col_values=(('external_ids', {'iface-id': '08acdf3d-6e0a-4b6f-9b4c-88731e6c0468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:50:65', 'vm-uuid': '185ac37f-d13e-4209-a195-a08acc8321c4'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:55 user nova-compute[74721]: INFO os_vif [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e')
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:14:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Creating image(s)
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Ensure instance console log exists: /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start _get_guest_xml network_info=[{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '1095340a-7298-4b27-8e5f-989adefe61c0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd043208f-7d0f-4017-8e4b-f3c28de3a88f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'serial': 'ecbdff50-f861-4bf2-a69a-7366d21b51a0'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:14:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:14:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:14:56 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab27e2d-3f15-4766-988b-50102961fa06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:14:56 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36710a9-df12-48bf-9616-b6464c512f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0] added
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda73fa1-f933-4573-8fe4-95ed72a91b01]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cdf398-ac7f-477b-98e8-b7d6e06bfcbc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlaGkTVx {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlaGkTVx" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0d02c-6149-4296-ae62-1323e9ecca12]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JlaGkTVx'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9aa43-2b72-4f58-a762-7bce364e7498]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f6fa9-b3fc-40e7-949e-c7fa31e58b16]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a74b31-1238-46ba-b9cd-8e87e9595494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]
Nov 02 23:14:56 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fcaff9-23ca-41ba-9f2d-24aa8cb16535]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e205f-5a7f-4b99-8125-76d2345e0d62]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:14:56 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[664719ae-3309-404e-8c1e-b5f32ddf45b5]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:14:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:57 user nova-compute[74721]: WARNING nova.compute.manager [req-a370c2fd-8c64-4602-a650-db1b7642c034 req-8129def6-e1bb-4adf-9498-15fbe101bad7 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 23:14:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23865663539393862', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663539393862', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAorZAvtfoyq4SLBBhxgQTiRIpi4CiKVQ3l47MYLHjlcsX1NskJ3y83XVLZsv4N3bTeX02GlgvwIukXvVwRfLACDm4SVXDoPA2kQzdzMOwfk9UtaXvCCfag9CbY+dxKqhQ==',key_name='tempest-TestShelveInstance-1797066865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:14:33Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.objects.instance [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'pci_devices' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:14:57 user nova-compute[74721]:   <uuid>d043208f-7d0f-4017-8e4b-f3c28de3a88f</uuid>
Nov 02 23:14:57 user nova-compute[74721]:   <name>instance-00000022</name>
Nov 02 23:14:57 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:14:57 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:14:57 user nova-compute[74721]:   <metadata>
Nov 02 23:14:57 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:14:57 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:14:57 user nova-compute[74721]:       <nova:name>tempest-TestShelveInstance-server-1774225187</nova:name>
Nov 02 23:14:57 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:14:56</nova:creationTime>
Nov 02 23:14:57 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:14:57 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:14:57 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:14:57 user nova-compute[74721]:       <nova:owner>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:user uuid="ace8a1614dbb40f1abbcec0433775de1">tempest-TestShelveInstance-1226338228-project-member</nova:user>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:project uuid="74a24963e0da47008a77678475eae00c">tempest-TestShelveInstance-1226338228</nova:project>
Nov 02 23:14:57 user nova-compute[74721]:       </nova:owner>
Nov 02 23:14:57 user nova-compute[74721]:       <nova:ports>
Nov 02 23:14:57 user nova-compute[74721]:         <nova:port uuid="894be900-e9b5-4bab-85e3-e97ea45970fc">
Nov 02 23:14:57 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 23:14:57 user nova-compute[74721]:         </nova:port>
Nov 02 23:14:57 user nova-compute[74721]:       </nova:ports>
Nov 02 23:14:57 user nova-compute[74721]:     </nova:instance>
Nov 02 23:14:57 user nova-compute[74721]:   </metadata>
Nov 02 23:14:57 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:14:57 user nova-compute[74721]:     <system>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="serial">d043208f-7d0f-4017-8e4b-f3c28de3a88f</entry>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="uuid">d043208f-7d0f-4017-8e4b-f3c28de3a88f</entry>
Nov 02 23:14:57 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:14:57 user nova-compute[74721]:     </system>
Nov 02 23:14:57 user nova-compute[74721]:   </sysinfo>
Nov 02 23:14:57 user nova-compute[74721]:   <os>
Nov 02 23:14:57 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:14:57 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:14:57 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:14:57 user nova-compute[74721]:   </os>
Nov 02 23:14:57 user nova-compute[74721]:   <features>
Nov 02 23:14:57 user nova-compute[74721]:     <acpi/>
Nov 02 23:14:57 user nova-compute[74721]:     <apic/>
Nov 02 23:14:57 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:14:57 user nova-compute[74721]:   </features>
Nov 02 23:14:57 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:14:57 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:14:57 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:14:57 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:14:57 user nova-compute[74721]:   </clock>
Nov 02 23:14:57 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:14:57 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:14:57 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:14:57 user nova-compute[74721]:   </cpu>
Nov 02 23:14:57 user nova-compute[74721]:   <devices>
Nov 02 23:14:57 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:14:57 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:14:57 user nova-compute[74721]:       <source dev="/dev/sde"/>
Nov 02 23:14:57 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:14:57 user nova-compute[74721]:       <serial>ecbdff50-f861-4bf2-a69a-7366d21b51a0</serial>
Nov 02 23:14:57 user nova-compute[74721]:     </disk>
Nov 02 23:14:57 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:14:57 user nova-compute[74721]:       <mac address="fa:16:3e:2e:d9:13"/>
Nov 02 23:14:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:57 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:14:57 user nova-compute[74721]:       <target dev="tap894be900-e9"/>
Nov 02 23:14:57 user nova-compute[74721]:     </interface>
Nov 02 23:14:57 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:14:57 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f/console.log" append="off"/>
Nov 02 23:14:57 user nova-compute[74721]:     </serial>
Nov 02 23:14:57 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:14:57 user nova-compute[74721]:     <video>
Nov 02 23:14:57 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:14:57 user nova-compute[74721]:     </video>
Nov 02 23:14:57 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:14:57 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:14:57 user nova-compute[74721]:     </rng>
Nov 02 23:14:57 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:14:57 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:14:57 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:14:57 user nova-compute[74721]:     </memballoon>
Nov 02 23:14:57 user nova-compute[74721]:   </devices>
Nov 02 23:14:57 user nova-compute[74721]: </domain>
Nov 02 23:14:57 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAorZAvtfoyq4SLBBhxgQTiRIpi4CiKVQ3l47MYLHjlcsX1NskJ3y83XVLZsv4N3bTeX02GlgvwIukXvVwRfLACDm4SVXDoPA2kQzdzMOwfk9UtaXvCCfag9CbY+dxKqhQ==',key_name='tempest-TestShelveInstance-1797066865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:14:33Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG os_vif [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68a0ffbe-c333-54a5-97a0-6922413b3672', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap894be900-e9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap894be900-e9, col_values=(('qos', UUID('693b30a3-6f0a-4426-be6e-5d5b613ddccd')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap894be900-e9, col_values=(('external_ids', {'iface-id': '894be900-e9b5-4bab-85e3-e97ea45970fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:d9:13', 'vm-uuid': 'd043208f-7d0f-4017-8e4b-f3c28de3a88f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:14:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:57 user nova-compute[74721]: INFO os_vif [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9')
Nov 02 23:14:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] No VIF found with MAC fa:16:3e:2e:d9:13, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:59 user nova-compute[74721]: WARNING nova.compute.manager [req-682f864e-9d57-4438-8cf3-06d2d270e27c req-51178dcc-3b17-4147-a55c-1a0ac03c1456 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state building and task_state spawning.
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:14:59 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance rebooted successfully.
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:14:59 user nova-compute[74721]: WARNING nova.compute.manager [req-07888e4b-0959-40d8-a534-5b6557942719 req-a1e20092-f955-4bfc-a950-e98b33ccef1c service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 23:14:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-09a28af0-51b3-441d-aa02-32d42e705344 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.645s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:14:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:15:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance spawned successfully.
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:15:01 user nova-compute[74721]: WARNING nova.compute.manager [req-e7617edd-0c3f-4eee-8957-87fd177e63f6 req-f3ee1e54-90ad-41e3-a602-f7fa96152c0e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state building and task_state spawning.
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:15:01 user nova-compute[74721]: INFO nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 02 23:15:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:15:01 user nova-compute[74721]: INFO nova.compute.manager [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Took 30.20 seconds to build instance.
Nov 02 23:15:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-853d6090-d784-421c-b90b-767d813b7d13 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.343s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:13 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7645d21-5b03-4efb-9049-3178c9384108 is timed out.
Nov 02 23:15:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance b7645d21-5b03-4efb-9049-3178c9384108 from the live domain config.
Nov 02 23:15:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOnCFGIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:15:13 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[172152c3-5a59-44e7-b280-fbdd30610f48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:15:13 user nova-compute[74721]: No targets found.
Nov 02 23:15:13 user nova-compute[74721]: iSNS:
Nov 02 23:15:13 user nova-compute[74721]: No targets found.
Nov 02 23:15:13 user nova-compute[74721]: STATIC:
Nov 02 23:15:13 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0
Nov 02 23:15:13 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:13 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:13 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:15:13 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:13 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:13 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c
Nov 02 23:15:13 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:13 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:13 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5
Nov 02 23:15:13 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:13 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:13 user nova-compute[74721]: FIRMWARE:
Nov 02 23:15:13 user nova-compute[74721]: No targets found.
Nov 02 23:15:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:15:13 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:15:13 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce809a-b084-4844-b265-81d1e9714121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad3bd7-6734-4fd1-9f65-efeda09eb7c5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24377400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b6510-f0bb-4af7-adde-96f9044b99fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a92d775-3beb-4125-b3ed-b211092e2e67]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f524969c-479a-4db9-8412-9b8941acd07d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1bc04-50db-4470-a310-c1c98150be57]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88d7aad-6aec-4a7c-8799-27702cf3b8b8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5cb19-284e-4b40-8482-d13b2473e6cf]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260]
Nov 02 23:15:13 user nova-compute[74721]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5, portal: 172.16.0.220,3260] successful.
Nov 02 23:15:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:979f7c40-2ffa-427c-9aab-63aa226787c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee068c-e1dc-4803-880f-ad38bcb26a10]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== disconnect_volume: return (341ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:15:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:15:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-57fd53d0-24a9-4df6-8118-e34b8bd667eb tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.644s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:16 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 is timed out.
Nov 02 23:15:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config.
Nov 02 23:15:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEVNAHnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:15:16 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ef92de-36a6-4e84-a27f-c7e08c1ad382]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:15:16 user nova-compute[74721]: No targets found.
Nov 02 23:15:16 user nova-compute[74721]: iSNS:
Nov 02 23:15:16 user nova-compute[74721]: No targets found.
Nov 02 23:15:16 user nova-compute[74721]: STATIC:
Nov 02 23:15:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0
Nov 02 23:15:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:15:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:16 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c
Nov 02 23:15:16 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:15:16 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:15:16 user nova-compute[74721]: FIRMWARE:
Nov 02 23:15:16 user nova-compute[74721]: No targets found.
Nov 02 23:15:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:15:16 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:15:16 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd61e3-c6c6-470a-b878-2cf6bf35305a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f3777-75cf-41a6-a546-9e165d1c9f1a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:15:16 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:16 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c (non-flash)
Nov 02 23:15:16 user nova-compute[74721]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:16 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf0479f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787c6a1-d26d-4502-896d-0dd28890461d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c66e12-99c0-4f26-a64d-a0a65ae18a6a]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e29d30-b999-4788-a4da-202b2ab37387]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[99022f89-1d4c-41b5-93c2-fcaa96d0ed2f]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8204ee7-39cf-41b0-8e6e-f6fa3346ae28]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --logout" returned: 0 in 0.168s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dead2e0b-6670-44d5-87be-4b18556b1cf8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260]
Nov 02 23:15:16 user nova-compute[74721]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c, portal: 172.16.0.220,3260] successful.
Nov 02 23:15:16 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfdc6a3a-6a92-4b9d-abe9-7b780730097c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba22e3fd-ae65-4587-b365-b2e7c19badba]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== disconnect_volume: return (559ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:15:16 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:15:17 user nova-compute[74721]: DEBUG nova.objects.instance [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-4578e458-8dd2-4bc9-ab23-98f375a837c9 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.811s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWjrhlzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:15:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:15:23 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:15:23 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8d4ad0-1479-464a-b3a1-a2a372cf606f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:15:23 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[42039687-6e5b-4b19-bb73-1d0d8495b637]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000] added
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74745a9-66b9-49c8-8121-05b42bf8e8ca]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19107d93-1561-40ec-8f45-fd976c8a7209]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWjrhlzb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWjrhlzb" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff183604-764d-447b-80eb-1aa1a49fa1c4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cWjrhlzb'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae744ae-1aa6-4f6d-9e90-ad6a61f37739]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b380d8c-a792-4691-a6df-8e9dcef1910c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940a0da-25b2-43e6-a570-efd923f19c89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260]
Nov 02 23:15:23 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260] successful.
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f629bd5a-735c-4788-9d60-05fe17c956b7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a547af76-0d5c-4558-b6d1-0da2e1fdeb05]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:15:23 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:15:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2116d-cc8b-4420-93f6-8508bdc723db]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWjrhlzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23435666665663136', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435666665663136', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.objects.instance [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:15:25 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:15:25 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:15:25 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:15:25 user nova-compute[74721]:   <serial>8a0726c6-2efa-4aed-a2d5-9127e98e5000</serial>
Nov 02 23:15:25 user nova-compute[74721]: </disk>
Nov 02 23:15:25 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] No VIF found with MAC fa:16:3e:e2:f8:1c, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:15:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-20633eca-4aee-4f5d-b071-5e204b0719a7 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.610s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:35 user nova-compute[74721]: INFO nova.compute.manager [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Terminating instance
Nov 02 23:15:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-unplugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] No waiting events found dispatching network-vif-unplugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.compute.manager [req-7afe47aa-4d51-4a56-8371-d3e950cf529c req-d1f96737-011d-4471-909d-1fb396248f70 service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-unplugged-923ab59f-9276-44a6-88c0-f7388ba29d12 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:15:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Instance destroyed successfully.
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.objects.instance [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lazy-loading 'resources' on Instance uuid 3f539868-3357-4719-a715-39ab06bf8898 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T22:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-762263899',display_name='tempest-ServerActionsTestOtherA-server-762263899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-762263899',id=4,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSfvKfAVKLgmZxMnBA+9yB1ZrWC7nJiX3WNUOqyrLUwmp+6y2LijSJLdvLH0TyLoTxGkaTcT5gh3kcjgXGfBZIW157+hSswpHk10k8pc/srpRnVB4bKxGapWpv/8i4g5Q==',key_name='tempest-keypair-898733799',keypairs=<?>,launch_index=0,launched_at=2023-11-02T22:55:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d9ed314de1541b6854e6158ee0816a0',ramdisk_id='',reservation_id='r-r1hoc1az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-756381715',owner_user_name='tempest-ServerActionsTestOtherA-756381715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T22:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3fb4cd21c349a1b60f075ffa63f393',uuid=3f539868-3357-4719-a715-39ab06bf8898,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converting VIF {"id": "923ab59f-9276-44a6-88c0-f7388ba29d12", "address": "fa:16:3e:b5:19:70", "network": {"id": "268ec9e5-35eb-4a35-a683-5263fb30b183", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-821384671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9ed314de1541b6854e6158ee0816a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap923ab59f-92", "ovs_interfaceid": "923ab59f-9276-44a6-88c0-f7388ba29d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG os_vif [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap923ab59f-92, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdf7919f-f205-4f5f-93f3-8b83a8d55a54) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:36 user nova-compute[74721]: INFO os_vif [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:19:70,bridge_name='br-int',has_traffic_filtering=True,id=923ab59f-9276-44a6-88c0-f7388ba29d12,network=Network(268ec9e5-35eb-4a35-a683-5263fb30b183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap923ab59f-92')
Nov 02 23:15:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Deleting instance files /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898_del
Nov 02 23:15:36 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Deletion of /opt/stack/data/nova/instances/3f539868-3357-4719-a715-39ab06bf8898_del complete
Nov 02 23:15:36 user nova-compute[74721]: INFO nova.compute.manager [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 02 23:15:36 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:15:36 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:15:37 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:15:37 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Took 1.06 seconds to deallocate network for instance.
Nov 02 23:15:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:37 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:15:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:15:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:37 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Deleted allocations for instance 3f539868-3357-4719-a715-39ab06bf8898
Nov 02 23:15:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bfbc2b59-4171-4afd-a32c-efe8f544c9ac tempest-ServerActionsTestOtherA-756381715 tempest-ServerActionsTestOtherA-756381715-project-member] Lock "3f539868-3357-4719-a715-39ab06bf8898" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] Acquiring lock "3f539868-3357-4719-a715-39ab06bf8898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] Lock "3f539868-3357-4719-a715-39ab06bf8898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] No waiting events found dispatching network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:15:38 user nova-compute[74721]: WARNING nova.compute.manager [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received unexpected event network-vif-plugged-923ab59f-9276-44a6-88c0-f7388ba29d12 for instance with vm_state deleted and task_state None.
Nov 02 23:15:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-b5336ea4-a46e-4eb2-ada1-7f4ecc794da6 req-0d7af57f-b11f-4092-858c-e350f4788e9e service nova] [instance: 3f539868-3357-4719-a715-39ab06bf8898] Received event network-vif-deleted-923ab59f-9276-44a6-88c0-f7388ba29d12 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:42 user nova-compute[74721]: INFO nova.compute.manager [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Terminating instance
Nov 02 23:15:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-unplugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] No waiting events found dispatching network-vif-unplugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:15:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-d847b9cc-5aa7-4e66-afee-f849b2799648 req-d4e8b7f7-af76-4bbf-951e-05e38807d877 service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-unplugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:15:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Instance destroyed successfully.
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'resources' on Instance uuid b7645d21-5b03-4efb-9049-3178c9384108 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740181398',display_name='tempest-AttachVolumeNegativeTest-server-740181398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740181398',id=31,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDkaQPuFxMtFaJCqRXHowx2IA+zJVTNrhhrkhZ4II/4MnP02OtrScjoFWAZaTf7xmM17oAlcd8XYg9KOWQPMuW0yCVJli4w+/BZcNGQbJy4nV7Gsr3ggb+VRhCZas+8LQ==',key_name='tempest-keypair-636253626',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-jlm85yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=b7645d21-5b03-4efb-9049-3178c9384108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "address": "fa:16:3e:dd:df:8d", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd62ad6-60", "ovs_interfaceid": "4dd62ad6-608e-4bea-8b3a-0e30c0d91688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG os_vif [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dd62ad6-60, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2528b9ba-d24d-4084-893f-ed8b1a1aec14) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:15:43 user nova-compute[74721]: INFO os_vif [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:df:8d,bridge_name='br-int',has_traffic_filtering=True,id=4dd62ad6-608e-4bea-8b3a-0e30c0d91688,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd62ad6-60')
Nov 02 23:15:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Deleting instance files /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108_del
Nov 02 23:15:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Deletion of /opt/stack/data/nova/instances/b7645d21-5b03-4efb-9049-3178c9384108_del complete
Nov 02 23:15:43 user nova-compute[74721]: INFO nova.compute.manager [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 02 23:15:43 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:15:43 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:15:44 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Took 0.97 seconds to deallocate network for instance.
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] Acquiring lock "b7645d21-5b03-4efb-9049-3178c9384108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] Lock "b7645d21-5b03-4efb-9049-3178c9384108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] No waiting events found dispatching network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:15:44 user nova-compute[74721]: WARNING nova.compute.manager [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received unexpected event network-vif-plugged-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 for instance with vm_state deleted and task_state None.
Nov 02 23:15:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-ff0ffc7f-443c-45f6-9b54-4925a5190417 req-d0e9c010-b285-488d-8546-e986fde36d2c service nova] [instance: b7645d21-5b03-4efb-9049-3178c9384108] Received event network-vif-deleted-4dd62ad6-608e-4bea-8b3a-0e30c0d91688 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:15:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:45 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Deleted allocations for instance b7645d21-5b03-4efb-9049-3178c9384108
Nov 02 23:15:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d9cfb2be-9587-486e-a4d0-dc9f1d9dc60d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "b7645d21-5b03-4efb-9049-3178c9384108" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.454s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:15:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:49 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:51 user nova-compute[74721]: INFO nova.compute.manager [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attaching volume c979401f-e519-4fcf-a4fe-ae59c0a2f783 to /dev/vdb
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.utils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b76dea-2583-4c68-9084-ed2d7e14acb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[17076a68-6f39-4951-b8bf-ba896f88fb51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b968ba8a-6790-46b3-9665-6224a9848e37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a98352-50f7-474c-896b-6d3df6eec6ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:15:51 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:15:51 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[90401c64-c3f4-44dd-a47a-f94fceda7f1f]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG os_brick.utils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:15:51 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating existing volume attachment record: 356a2a97-026e-49ca-90c2-6d5f11845807 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:15:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:15:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=25.28392791748047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 15cd8cea-8506-43da-b3c6-69412acbae96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ee1c3ce6-0281-46ae-98c3-df163d075533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance d043208f-7d0f-4017-8e4b-f3c28de3a88f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:15:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:15:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:15:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing instance network info cache due to event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWytkUSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:13 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:13 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:13 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b035f-c7b3-4d28-ba13-90c19993d9fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:16:13 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f43596-0cbf-4f44-a179-afbc4c71cbf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783] added
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea9abff-db67-427a-8ef1-cc17af8fa54a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[43977e7c-7a84-4463-a2e1-45cf6beebfb4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWytkUSz {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWytkUSz" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4438a63b-f625-4c31-979b-ae1aacacb2f5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWytkUSz'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8163f-706c-49a2-af11-6db1037f8522]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a46e2-3a4b-4c84-8e52-5d32516e88c4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855a31f-70e7-4986-83f6-92474a9b5a85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260]
Nov 02 23:16:13 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260] successful.
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cc46a5-ae06-40f1-af23-6f8e8393799e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb470cd9-13cd-4e4c-a8d5-b66befd1d61f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:13 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updated VIF entry in instance network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8f1e1-e54a-44e6-b872-87f5afb5a854]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:16:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e2d3e164-e543-4d5b-b7a9-165a8c9514c2 req-ee318df8-ee8f-41cc-b23c-d75ef480af89 service nova] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWytkUSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26639313535643933', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313535643933', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:16:14 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:14 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:16:14 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:14 user nova-compute[74721]:   <serial>c979401f-e519-4fcf-a4fe-ae59c0a2f783</serial>
Nov 02 23:16:14 user nova-compute[74721]: </disk>
Nov 02 23:16:14 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:16:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No VIF found with MAC fa:16:3e:ac:49:ba, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:16:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5861e882-9f72-4864-bebc-32058cc91129 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.531s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:16 user nova-compute[74721]: INFO nova.compute.manager [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Detaching volume c979401f-e519-4fcf-a4fe-ae59c0a2f783
Nov 02 23:16:17 user nova-compute[74721]: INFO nova.virt.block_device [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attempting to driver detach volume c979401f-e519-4fcf-a4fe-ae59c0a2f783 from mountpoint /dev/vdb
Nov 02 23:16:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Attempting to detach device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:16:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:17 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:17 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:16:17 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:17 user nova-compute[74721]:   <serial>c979401f-e519-4fcf-a4fe-ae59c0a2f783</serial>
Nov 02 23:16:17 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:16:17 user nova-compute[74721]: </disk>
Nov 02 23:16:17 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:17 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config.
Nov 02 23:16:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:16:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:17 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:17 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:16:17 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:17 user nova-compute[74721]:   <serial>c979401f-e519-4fcf-a4fe-ae59c0a2f783</serial>
Nov 02 23:16:17 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:16:17 user nova-compute[74721]: </disk>
Nov 02 23:16:17 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:17 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:16:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:20 user nova-compute[74721]: INFO nova.compute.manager [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Shelving
Nov 02 23:16:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:21 user nova-compute[74721]: WARNING nova.compute.manager [req-de522aba-1705-429d-bf96-e88bff40754c req-0f0db771-cfbd-4914-aef1-89fbcf459c86 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state active and task_state shelving.
Nov 02 23:16:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:21 user nova-compute[74721]: INFO nova.compute.manager [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Detaching volume 8a0726c6-2efa-4aed-a2d5-9127e98e5000
Nov 02 23:16:21 user nova-compute[74721]: INFO nova.virt.block_device [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Attempting to driver detach volume 8a0726c6-2efa-4aed-a2d5-9127e98e5000 from mountpoint /dev/vdb
Nov 02 23:16:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Attempting to detach device vdb from instance 15cd8cea-8506-43da-b3c6-69412acbae96 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:21 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:21 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:16:21 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:21 user nova-compute[74721]:   <serial>8a0726c6-2efa-4aed-a2d5-9127e98e5000</serial>
Nov 02 23:16:21 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:16:21 user nova-compute[74721]: </disk>
Nov 02 23:16:21 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully detached device vdb from instance 15cd8cea-8506-43da-b3c6-69412acbae96 from the persistent domain config.
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15cd8cea-8506-43da-b3c6-69412acbae96 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:21 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:21 user nova-compute[74721]:   <source dev="/dev/sdb"/>
Nov 02 23:16:21 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:21 user nova-compute[74721]:   <serial>8a0726c6-2efa-4aed-a2d5-9127e98e5000</serial>
Nov 02 23:16:21 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:16:21 user nova-compute[74721]: </disk>
Nov 02 23:16:21 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance destroyed successfully.
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Beginning cold snapshot process
Nov 02 23:16:21 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:16:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk /opt/stack/data/nova/instances/snapshots/tmp3g8c6mmg/5d52dc623d3649ad8c3725c798f001a0 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:16:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk /opt/stack/data/nova/instances/snapshots/tmp3g8c6mmg/5d52dc623d3649ad8c3725c798f001a0" returned: 0 in 1.050s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Snapshot extracted, beginning image upload
Nov 02 23:16:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:23 user nova-compute[74721]: WARNING nova.compute.manager [req-c9b1f330-b38c-440a-a26d-7cd7249cbd35 req-56edaf71-1b50-43e0-a91b-ca5cfe1a0048 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 23:16:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:24 user nova-compute[74721]: INFO nova.compute.manager [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Shelve offloading
Nov 02 23:16:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:24 user nova-compute[74721]: WARNING nova.compute.manager [req-62601e4b-daf0-4d23-861f-5b1382e18d1b req-1f66ad28-df1f-4787-bd1f-1b7c4738b39e service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state active and task_state shelving.
Nov 02 23:16:25 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance destroyed successfully.
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing instance network info cache due to event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:25 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Snapshot image upload complete
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:25 user nova-compute[74721]: INFO nova.compute.manager [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Shelve offloading
Nov 02 23:16:25 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance destroyed successfully.
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:25 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG nova.network.neutron [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG nova.network.neutron [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG nova.network.neutron [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:26 user nova-compute[74721]: WARNING nova.compute.manager [req-9d7c88ea-28ab-4d37-919d-d2b15441c519 req-502a4c24-1b17-4b3d-90b1-8067b4d124a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state active and task_state shelving.
Nov 02 23:16:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance destroyed successfully.
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.objects.instance [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'resources' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAorZAvtfoyq4SLBBhxgQTiRIpi4CiKVQ3l47MYLHjlcsX1NskJ3y83XVLZsv4N3bTeX02GlgvwIukXvVwRfLACDm4SVXDoPA2kQzdzMOwfk9UtaXvCCfag9CbY+dxKqhQ==',key_name='tempest-TestShelveInstance-1797066865',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:15:02Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_vif [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap894be900-e9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updated VIF entry in instance network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing instance network info cache due to event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=693b30a3-6f0a-4426-be6e-5d5b613ddccd) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-469b4a2f-b11d-451c-85f2-5d5560ab16a7 req-6c6074b3-7f47-4443-862d-8bb93d442ae4 service nova] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: INFO os_vif [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9')
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[373110db-91b6-4b7d-95af-4ad3380ace9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:16:27 user nova-compute[74721]: No targets found.
Nov 02 23:16:27 user nova-compute[74721]: iSNS:
Nov 02 23:16:27 user nova-compute[74721]: No targets found.
Nov 02 23:16:27 user nova-compute[74721]: STATIC:
Nov 02 23:16:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0
Nov 02 23:16:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783
Nov 02 23:16:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:16:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000
Nov 02 23:16:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:27 user nova-compute[74721]: FIRMWARE:
Nov 02 23:16:27 user nova-compute[74721]: No targets found.
Nov 02 23:16:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:16:27 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:16:27 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[857ee06e-e735-4f15-94a8-d2c252f7e42e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance destroyed successfully.
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'resources' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMALd36Qxsw8QMp5xI5aCMKDyO1mL9mLSl51t6QQ4wB6n9ydImx6hZXuP8j7NKK08DXKswKD5OXgkt9MnbEeeG7ochwLXWxPHwmkZaQJy6LFsFIcCzPnoxjrqNw7AC28SA==',key_name='tempest-keypair-688781644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:16:25.771896',shelved_host='user',shelved_image_id='3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_vif [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2bd5cff-87, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9df98265-01bb-4699-8142-19e7937c916c) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[310639d9-ded9-4b52-a1ea-ab9ee26681dd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf243b32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:27 user nova-compute[74721]: INFO os_vif [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87')
Nov 02 23:16:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Deleting instance files /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533_del
Nov 02 23:16:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Deletion of /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533_del complete
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6c509-f4b0-40bf-a155-1c9f13deaa67]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecde420-97cc-4281-9da7-10f856045799]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfa1f67-59ae-4170-b968-847f2f5a4c17]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff461714-f0fd-484c-8b1c-de54e269ca24]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c56086d-ae2d-432a-8463-20ce595b1ef8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:27 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Deleted allocations for instance ee1c3ce6-0281-46ae-98c3-df163d075533
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bae48-e959-4f01-9ecc-37e4384c5e38]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]
Nov 02 23:16:28 user nova-compute[74721]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:16:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d9f8e-d764-453a-8555-6cc3e3cb7d59]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== disconnect_volume: return (352ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:16:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deleting instance files /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f_del
Nov 02 23:16:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deletion of /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f_del complete
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'numa_topology' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.objects.base [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<ee1c3ce6-0281-46ae-98c3-df163d075533> lazy-loaded attributes: resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updated VIF entry in instance network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": null, "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap894be900-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bb6d78c5-3f83-4ef6-93c0-5510b58fbb14 req-2d36b4e4-bfbc-40e3-a577-9b4cf6a210bc service nova] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e5f98372-ca55-4539-9c02-bd5bfc79ce74 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.809s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:16:28 user nova-compute[74721]: INFO nova.compute.claims [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Claim successful on node user
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:16:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.policy [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:16:29 user nova-compute[74721]: INFO nova.virt.block_device [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Booting with volume snapshot cc7c9136-943a-47cb-a385-065120762ce2 at /dev/vda
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:29 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Deleted allocations for instance d043208f-7d0f-4017-8e4b-f3c28de3a88f
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'numa_topology' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.objects.base [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Object Instance<d043208f-7d0f-4017-8e4b-f3c28de3a88f> lazy-loaded attributes: resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.271s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Successfully created port: 92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:16:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:16:29 user nova-compute[74721]: INFO nova.compute.claims [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Claim successful on node user
Nov 02 23:16:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-399c3f94-2cc4-41e3-a322-e570bd6baf4f tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.614s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:16:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:16:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Creating image(s)
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG nova.policy [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee89915190bc4dcaafc152b0767d70a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc5e65b042947ed8f88d0a0722d2f78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk 1073741824" returned: 0 in 0.056s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Cannot resize image /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Ensure instance console log exists: /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Successfully updated port: 92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-changed-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Refreshing instance network info cache due to event network-changed-92ea5c04-9466-4d5d-8994-6a4a53d5318b. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] Acquiring lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:16:31 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Successfully created port: 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Updating instance_info_cache with network_info: [{"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Instance network_info: |[{"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] Acquired lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Refreshing network info cache for port 92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Updated VIF entry in instance network info cache for port 92ea5c04-9466-4d5d-8994-6a4a53d5318b. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Updating instance_info_cache with network_info: [{"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1611ac55-c447-4d37-bcaf-2c18e681b6a6 req-905aa67c-19bf-44d0-b497-e373b38d0246 service nova] Releasing lock "refresh_cache-e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Successfully updated port: 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:32 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.neutron [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance network_info: |[{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start _get_guest_xml network_info=[{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:16:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606480863',display_name='tempest-ServerRescueNegativeTestJSON-server-606480863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606480863',id=36,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZtwikCAcxIuESk9O23FU5EtdfS+/vVWL0PgZOOvpbCMg6V/MhBHwLfozhAXcDP2kN8wrz1Fmp/L/hK5ip3bYocAIZA3/ABnG2p6WE9DphcTzLQzAXXdv51+4WNYyFhw==',key_name='tempest-keypair-1005684426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-vg70b9bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=47459418-703e-46a3-bc42-b7034ee8af46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:16:33 user nova-compute[74721]:   <uuid>47459418-703e-46a3-bc42-b7034ee8af46</uuid>
Nov 02 23:16:33 user nova-compute[74721]:   <name>instance-00000024</name>
Nov 02 23:16:33 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:16:33 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:16:33 user nova-compute[74721]:   <metadata>
Nov 02 23:16:33 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:16:33 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-606480863</nova:name>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:16:33</nova:creationTime>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:16:33 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:16:33 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:owner>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:16:33 user nova-compute[74721]:       </nova:owner>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:16:33 user nova-compute[74721]:       <nova:ports>
Nov 02 23:16:33 user nova-compute[74721]:         <nova:port uuid="402d30fc-6fb0-4996-965d-8cc06efb456f">
Nov 02 23:16:33 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 23:16:33 user nova-compute[74721]:         </nova:port>
Nov 02 23:16:33 user nova-compute[74721]:       </nova:ports>
Nov 02 23:16:33 user nova-compute[74721]:     </nova:instance>
Nov 02 23:16:33 user nova-compute[74721]:   </metadata>
Nov 02 23:16:33 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:16:33 user nova-compute[74721]:     <system>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="serial">47459418-703e-46a3-bc42-b7034ee8af46</entry>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="uuid">47459418-703e-46a3-bc42-b7034ee8af46</entry>
Nov 02 23:16:33 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:16:33 user nova-compute[74721]:     </system>
Nov 02 23:16:33 user nova-compute[74721]:   </sysinfo>
Nov 02 23:16:33 user nova-compute[74721]:   <os>
Nov 02 23:16:33 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:16:33 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:16:33 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:16:33 user nova-compute[74721]:   </os>
Nov 02 23:16:33 user nova-compute[74721]:   <features>
Nov 02 23:16:33 user nova-compute[74721]:     <acpi/>
Nov 02 23:16:33 user nova-compute[74721]:     <apic/>
Nov 02 23:16:33 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:16:33 user nova-compute[74721]:   </features>
Nov 02 23:16:33 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:16:33 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:16:33 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:16:33 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:16:33 user nova-compute[74721]:   </clock>
Nov 02 23:16:33 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:16:33 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:16:33 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:16:33 user nova-compute[74721]:   </cpu>
Nov 02 23:16:33 user nova-compute[74721]:   <devices>
Nov 02 23:16:33 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:16:33 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:16:33 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk"/>
Nov 02 23:16:33 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:16:33 user nova-compute[74721]:     </disk>
Nov 02 23:16:33 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:16:33 user nova-compute[74721]:       <mac address="fa:16:3e:53:23:3a"/>
Nov 02 23:16:33 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:33 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:16:33 user nova-compute[74721]:       <target dev="tap402d30fc-6f"/>
Nov 02 23:16:33 user nova-compute[74721]:     </interface>
Nov 02 23:16:33 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:16:33 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/console.log" append="off"/>
Nov 02 23:16:33 user nova-compute[74721]:     </serial>
Nov 02 23:16:33 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:16:33 user nova-compute[74721]:     <video>
Nov 02 23:16:33 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:33 user nova-compute[74721]:     </video>
Nov 02 23:16:33 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:16:33 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:16:33 user nova-compute[74721]:     </rng>
Nov 02 23:16:33 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:16:33 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:16:33 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:16:33 user nova-compute[74721]:     </memballoon>
Nov 02 23:16:33 user nova-compute[74721]:   </devices>
Nov 02 23:16:33 user nova-compute[74721]: </domain>
Nov 02 23:16:33 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606480863',display_name='tempest-ServerRescueNegativeTestJSON-server-606480863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606480863',id=36,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZtwikCAcxIuESk9O23FU5EtdfS+/vVWL0PgZOOvpbCMg6V/MhBHwLfozhAXcDP2kN8wrz1Fmp/L/hK5ip3bYocAIZA3/ABnG2p6WE9DphcTzLQzAXXdv51+4WNYyFhw==',key_name='tempest-keypair-1005684426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-vg70b9bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=47459418-703e-46a3-bc42-b7034ee8af46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG os_vif [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab3c54e1-c378-5d4f-8c5d-47802b6f29cc', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap402d30fc-6f, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap402d30fc-6f, col_values=(('qos', UUID('71ffb4fa-8319-4c4c-997f-638dc6eb8f69')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap402d30fc-6f, col_values=(('external_ids', {'iface-id': '402d30fc-6fb0-4996-965d-8cc06efb456f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:23:3a', 'vm-uuid': '47459418-703e-46a3-bc42-b7034ee8af46'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:33 user nova-compute[74721]: INFO os_vif [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f')
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:53:23:3a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing instance network info cache due to event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:33 user nova-compute[74721]: DEBUG nova.network.neutron [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG nova.network.neutron [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updated VIF entry in instance network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG nova.network.neutron [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-231e7cf4-df45-4565-8fd4-c49ce937803d req-e7e36be3-020a-44db-94ce-75027f26f04b service nova] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.utils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705b210-d900-4f30-8ef2-2682cbd0f739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473ac22-6000-46a0-9861-c736dca24d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:35 user nova-compute[74721]: WARNING nova.compute.manager [req-4d7eb8fc-ce08-4e7f-9eb1-14f4e47a2566 req-41871525-6750-46d3-b6ac-0efef014c2a1 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state building and task_state spawning.
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f2ce32-3a50-49d1-a35d-6866fbaf6b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2725bc-c4e0-44c8-9a66-7db655881974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:16:35 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:16:35 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e23a28d-d047-41a0-81c8-46b70dfe59b8]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG os_brick.utils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:35 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Updating existing volume attachment record: 7089bf83-d638-4b5c-8ca3-35a8d7522d6b {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:16:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance spawned successfully.
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:37 user nova-compute[74721]: WARNING nova.compute.manager [req-ae44bde7-c35f-4415-9be6-febaaeaf370a req-0f29edc0-26ae-4c7a-adff-8b77cacc3921 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state building and task_state spawning.
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.compute.manager [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Took 7.80 seconds to build instance.
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1bd1e4cc-cde6-4ede-8431-c64255fe7803 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.911s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.compute.claims [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Claim successful on node user
Nov 02 23:16:37 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 is timed out.
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config.
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWytkUSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:37 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5449c4-e0ba-4fd6-9979-0c550d4f8252]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:16:37 user nova-compute[74721]: No targets found.
Nov 02 23:16:37 user nova-compute[74721]: iSNS:
Nov 02 23:16:37 user nova-compute[74721]: No targets found.
Nov 02 23:16:37 user nova-compute[74721]: STATIC:
Nov 02 23:16:37 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783
Nov 02 23:16:37 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:37 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:37 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:16:37 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:37 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:37 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000
Nov 02 23:16:37 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:37 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:37 user nova-compute[74721]: FIRMWARE:
Nov 02 23:16:37 user nova-compute[74721]: No targets found.
Nov 02 23:16:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:16:37 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:16:37 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac72365-ad66-4fc4-9efa-0ebf23ca0c11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3cf22e-9a6c-4762-ab30-c5a9489f0096]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 (non-flash)
Nov 02 23:16:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf0479e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f97911-eb8c-48e9-a60b-6a86c4858024]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2372b8-4950-4b30-bbb8-177e22a448d3]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9ad08-b2f6-476e-8be7-39ea35d4c3d2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[062f4d39-e1d5-45a5-aba5-290e2b8acdc4]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df9e11a-929a-4dee-b6df-0774b844fc53]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad75d5b-1fb5-446d-bfa7-c1d08e5e08ad]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260]
Nov 02 23:16:37 user nova-compute[74721]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783, portal: 172.16.0.220,3260] successful.
Nov 02 23:16:37 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c979401f-e519-4fcf-a4fe-ae59c0a2f783 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c06698-72f1-441d-bf6b-256b93447ec4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== disconnect_volume: return (363ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:16:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:16:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:16:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Creating image(s)
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "/opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.policy [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83010d67d3514cd69c99767c0b77fb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd99aa517e74a5aa15c46d174a025b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk 1073741824" returned: 0 in 0.056s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG nova.objects.instance [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9a19160f-dc0f-4b06-81e0-0bd00d3ad638 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Cannot resize image /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Ensure instance console log exists: /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:39 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:16:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Successfully created port: bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing instance network info cache due to event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:42 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15cd8cea-8506-43da-b3c6-69412acbae96 is timed out.
Nov 02 23:16:42 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully detached device vdb from instance 15cd8cea-8506-43da-b3c6-69412acbae96 from the live domain config.
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWjrhlzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:42 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39244bf-7787-45e7-9ebc-e72f1902b7e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:16:42 user nova-compute[74721]: No targets found.
Nov 02 23:16:42 user nova-compute[74721]: iSNS:
Nov 02 23:16:42 user nova-compute[74721]: No targets found.
Nov 02 23:16:42 user nova-compute[74721]: STATIC:
Nov 02 23:16:42 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:16:42 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:42 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:42 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000
Nov 02 23:16:42 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:42 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:42 user nova-compute[74721]: FIRMWARE:
Nov 02 23:16:42 user nova-compute[74721]: No targets found.
Nov 02 23:16:42 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:16:42 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:16:42 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5894b6-6fec-4ace-bdd9-39a43eae8c6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ebd0a3-fd5e-496b-8c92-9faed3b58fea]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:42 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:42 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:42 user nova-compute[74721]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 (non-flash)
Nov 02 23:16:42 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c0f95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f2459-1137-452a-bcaa-e9ef43541faf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b10a2-7fdd-4076-bff3-7a2d2b1498bb]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319c0fc-c965-468d-8884-3160113d3753]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ebf3e5-1db9-46c8-aace-6d769c74c4c3]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f7024-4a31-4752-835b-7f8658d2057b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c21c36-4e37-4384-9d45-282c584fb83a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260]
Nov 02 23:16:42 user nova-compute[74721]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000, portal: 172.16.0.220,3260] successful.
Nov 02 23:16:42 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa5dc1-d9eb-4cfd-afd1-7d1780beb94e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== disconnect_volume: return (363ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Successfully updated port: bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquired lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-changed-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Refreshing instance network info cache due to event network-changed-bca8d68e-726f-40ff-af27-4af38ace54aa. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] Acquiring lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated VIF entry in instance network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:16:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-84459ae5-aad0-4f36-81f6-3e46858c35ff req-3df83652-e8f5-4bc2-a596-7030b733bf48 service nova] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing instance network info cache due to event network-changed-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] Acquiring lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] Acquired lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Refreshing network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updating instance_info_cache with network_info: [{"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Releasing lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Instance network_info: |[{"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] Acquired lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Refreshing network info cache for port bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Start _get_guest_xml network_info=[{"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:43 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:43 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:43 user nova-compute[74721]: INFO nova.compute.manager [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Detaching volume 117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098837632',display_name='tempest-AttachVolumeNegativeTest-server-2098837632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098837632',id=37,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcB6fqfNXCtVZYIyMeW7Wk1e8MMn3Gfh3VU7Fks8l57mpKE6mlSwwCXox3aEwJhp933gqAm2W7g+OPVKLj2O3bIZ4qyShUxTwQE5QlgnRh2hU4fAvlBZyUqcYTsE9v1Tg==',key_name='tempest-keypair-384855023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-m8dk4hj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=7f62294b-7c3c-4461-aa87-d70b65ae1528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.objects.instance [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:16:43 user nova-compute[74721]:   <uuid>7f62294b-7c3c-4461-aa87-d70b65ae1528</uuid>
Nov 02 23:16:43 user nova-compute[74721]:   <name>instance-00000025</name>
Nov 02 23:16:43 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:16:43 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:16:43 user nova-compute[74721]:   <metadata>
Nov 02 23:16:43 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:16:43 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2098837632</nova:name>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:16:43</nova:creationTime>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:16:43 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:16:43 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:owner>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:user uuid="83010d67d3514cd69c99767c0b77fb67">tempest-AttachVolumeNegativeTest-1503140472-project-member</nova:user>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:project uuid="0bd99aa517e74a5aa15c46d174a025b0">tempest-AttachVolumeNegativeTest-1503140472</nova:project>
Nov 02 23:16:43 user nova-compute[74721]:       </nova:owner>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:16:43 user nova-compute[74721]:       <nova:ports>
Nov 02 23:16:43 user nova-compute[74721]:         <nova:port uuid="bca8d68e-726f-40ff-af27-4af38ace54aa">
Nov 02 23:16:43 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:16:43 user nova-compute[74721]:         </nova:port>
Nov 02 23:16:43 user nova-compute[74721]:       </nova:ports>
Nov 02 23:16:43 user nova-compute[74721]:     </nova:instance>
Nov 02 23:16:43 user nova-compute[74721]:   </metadata>
Nov 02 23:16:43 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:16:43 user nova-compute[74721]:     <system>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="serial">7f62294b-7c3c-4461-aa87-d70b65ae1528</entry>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="uuid">7f62294b-7c3c-4461-aa87-d70b65ae1528</entry>
Nov 02 23:16:43 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:16:43 user nova-compute[74721]:     </system>
Nov 02 23:16:43 user nova-compute[74721]:   </sysinfo>
Nov 02 23:16:43 user nova-compute[74721]:   <os>
Nov 02 23:16:43 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:16:43 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:16:43 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:16:43 user nova-compute[74721]:   </os>
Nov 02 23:16:43 user nova-compute[74721]:   <features>
Nov 02 23:16:43 user nova-compute[74721]:     <acpi/>
Nov 02 23:16:43 user nova-compute[74721]:     <apic/>
Nov 02 23:16:43 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:16:43 user nova-compute[74721]:   </features>
Nov 02 23:16:43 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:16:43 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:16:43 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:16:43 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:16:43 user nova-compute[74721]:   </clock>
Nov 02 23:16:43 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:16:43 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:16:43 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:16:43 user nova-compute[74721]:   </cpu>
Nov 02 23:16:43 user nova-compute[74721]:   <devices>
Nov 02 23:16:43 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:16:43 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:16:43 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk"/>
Nov 02 23:16:43 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:16:43 user nova-compute[74721]:     </disk>
Nov 02 23:16:43 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:16:43 user nova-compute[74721]:       <mac address="fa:16:3e:69:8f:35"/>
Nov 02 23:16:43 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:43 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:16:43 user nova-compute[74721]:       <target dev="tapbca8d68e-72"/>
Nov 02 23:16:43 user nova-compute[74721]:     </interface>
Nov 02 23:16:43 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:16:43 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/console.log" append="off"/>
Nov 02 23:16:43 user nova-compute[74721]:     </serial>
Nov 02 23:16:43 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:16:43 user nova-compute[74721]:     <video>
Nov 02 23:16:43 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:43 user nova-compute[74721]:     </video>
Nov 02 23:16:43 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:16:43 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:16:43 user nova-compute[74721]:     </rng>
Nov 02 23:16:43 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:16:43 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:16:43 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:16:43 user nova-compute[74721]:     </memballoon>
Nov 02 23:16:43 user nova-compute[74721]:   </devices>
Nov 02 23:16:43 user nova-compute[74721]: </domain>
Nov 02 23:16:43 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098837632',display_name='tempest-AttachVolumeNegativeTest-server-2098837632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098837632',id=37,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcB6fqfNXCtVZYIyMeW7Wk1e8MMn3Gfh3VU7Fks8l57mpKE6mlSwwCXox3aEwJhp933gqAm2W7g+OPVKLj2O3bIZ4qyShUxTwQE5QlgnRh2hU4fAvlBZyUqcYTsE9v1Tg==',key_name='tempest-keypair-384855023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-m8dk4hj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=7f62294b-7c3c-4461-aa87-d70b65ae1528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG os_vif [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cece7616-716f-592b-a22d-2a5b202da32e', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbca8d68e-72, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbca8d68e-72, col_values=(('qos', UUID('b61a783e-2394-475d-9460-ca89abbd39d0')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbca8d68e-72, col_values=(('external_ids', {'iface-id': 'bca8d68e-726f-40ff-af27-4af38ace54aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:8f:35', 'vm-uuid': '7f62294b-7c3c-4461-aa87-d70b65ae1528'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: INFO os_vif [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72')
Nov 02 23:16:43 user nova-compute[74721]: INFO nova.virt.block_device [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Attempting to driver detach volume 117a437b-3a7a-47ef-be80-199a6ec97be5 from mountpoint /dev/vdb
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Attempting to detach device vdb from instance 185ac37f-d13e-4209-a195-a08acc8321c4 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:43 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:43 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:16:43 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:43 user nova-compute[74721]:   <serial>117a437b-3a7a-47ef-be80-199a6ec97be5</serial>
Nov 02 23:16:43 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:16:43 user nova-compute[74721]: </disk>
Nov 02 23:16:43 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully detached device vdb from instance 185ac37f-d13e-4209-a195-a08acc8321c4 from the persistent domain config.
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 185ac37f-d13e-4209-a195-a08acc8321c4 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:16:43 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:43 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:16:43 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:16:43 user nova-compute[74721]:   <serial>117a437b-3a7a-47ef-be80-199a6ec97be5</serial>
Nov 02 23:16:43 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:16:43 user nova-compute[74721]: </disk>
Nov 02 23:16:43 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:69:8f:35, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'flavor' on Instance uuid 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updated VIF entry in instance network info cache for port 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [{"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c16d87b9-0628-41bb-b3e3-5810dee40422 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.330s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d3c921d8-2246-4e0a-867c-0b1c14f81331 req-3e4e9570-1a6b-419b-85dc-059f4fd12f47 service nova] Releasing lock "refresh_cache-185ac37f-d13e-4209-a195-a08acc8321c4" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.195s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:43 user nova-compute[74721]: INFO nova.compute.manager [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Terminating instance
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updated VIF entry in instance network info cache for port bca8d68e-726f-40ff-af27-4af38ace54aa. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updating instance_info_cache with network_info: [{"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-635cbc40-2d6a-4da8-bbb4-921b362ac346 req-322e9900-4e70-430d-b5da-2297e988fe0b service nova] Releasing lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-unplugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] No waiting events found dispatching network-vif-unplugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-9b5bc131-d92a-4475-a27f-3fb57818d22c req-82bc59ae-e51d-416e-a5f8-a45e6e0539f8 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-unplugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:16:44 user nova-compute[74721]: INFO nova.compute.claims [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Claim successful on node user
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:16:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Instance destroyed successfully.
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.objects.instance [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lazy-loading 'resources' on Instance uuid 15cd8cea-8506-43da-b3c6-69412acbae96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1329067754',display_name='tempest-VolumesSnapshotTestJSON-instance-1329067754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1329067754',id=32,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbpTxBBwW+20VW+lF7Da2np4EUGUwhV6Afa6ryu3LL0Ra/HPEShaTcPOMLKkeSqcS2H21bZ6HEAUYblpluYm77EwUjvXDivjUOMmxKFd9Z+M2oWCUmDDzJhq/xhr8rKPA==',key_name='tempest-keypair-1081505893',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:13:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52745a8a23e0448c8e9e484dc3fc1ac4',ramdisk_id='',reservation_id='r-jn1lupk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-372484288',owner_user_name='tempest-VolumesSnapshotTestJSON-372484288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f64e0da7c457e8845a970d41294b9',uuid=15cd8cea-8506-43da-b3c6-69412acbae96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converting VIF {"id": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "address": "fa:16:3e:e2:f8:1c", "network": {"id": "8e418bb6-9e38-46ab-8964-44d575f07e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1108645248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52745a8a23e0448c8e9e484dc3fc1ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab975b5c-f7", "ovs_interfaceid": "ab975b5c-f72d-4a8c-8b11-f916b880ed3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_vif [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab975b5c-f7, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62beadd6-91fd-418d-afa5-207079df7b20) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: INFO os_vif [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:f8:1c,bridge_name='br-int',has_traffic_filtering=True,id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a,network=Network(8e418bb6-9e38-46ab-8964-44d575f07e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab975b5c-f7')
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWjrhlzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:45 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a0cc95-07f6-4aab-a5fc-15f00601349e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:16:45 user nova-compute[74721]: No targets found.
Nov 02 23:16:45 user nova-compute[74721]: iSNS:
Nov 02 23:16:45 user nova-compute[74721]: No targets found.
Nov 02 23:16:45 user nova-compute[74721]: STATIC:
Nov 02 23:16:45 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:16:45 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:16:45 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:16:45 user nova-compute[74721]: FIRMWARE:
Nov 02 23:16:45 user nova-compute[74721]: No targets found.
Nov 02 23:16:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:16:45 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:16:45 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0726c6-2efa-4aed-a2d5-9127e98e5000', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd687f1-bb38-4acf-ad0d-db44377ab3e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d891b60d-93b1-485f-b06d-b906168a51eb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:45 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c3924d0>, {}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Disconnecting from: [] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] <== disconnect_volume: return (91ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Deleting instance files /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96_del
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Deletion of /opt/stack/data/nova/instances/15cd8cea-8506-43da-b3c6-69412acbae96_del complete
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.policy [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b54b65445a47929910242fa7206851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0a955207b54b909bf41ecfc6198291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.compute.manager [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:16:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Creating image(s)
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.214s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk 1073741824" returned: 0 in 0.064s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.218s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] Acquiring lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] Lock "15cd8cea-8506-43da-b3c6-69412acbae96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] No waiting events found dispatching network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:46 user nova-compute[74721]: WARNING nova.compute.manager [req-845b6273-2986-441a-a419-6d46b316becc req-bd0d7038-c8eb-4aea-8e9d-f7b23caf6029 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received unexpected event network-vif-plugged-ab975b5c-f72d-4a8c-8b11-f916b880ed3a for instance with vm_state active and task_state deleting.
Nov 02 23:16:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Cannot resize image /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Successfully created port: 793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:46 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Took 1.17 seconds to deallocate network for instance.
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-521d9e19-9dea-4140-82a8-e3db48f5a050 req-126b405d-486d-406d-a2fe-9282b23a2e20 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Received event network-vif-deleted-ab975b5c-f72d-4a8c-8b11-f916b880ed3a {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:46 user nova-compute[74721]: INFO nova.compute.manager [req-521d9e19-9dea-4140-82a8-e3db48f5a050 req-126b405d-486d-406d-a2fe-9282b23a2e20 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Neutron deleted interface ab975b5c-f72d-4a8c-8b11-f916b880ed3a; detaching it from the instance and deleting it from the info cache
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.network.neutron [req-521d9e19-9dea-4140-82a8-e3db48f5a050 req-126b405d-486d-406d-a2fe-9282b23a2e20 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-521d9e19-9dea-4140-82a8-e3db48f5a050 req-126b405d-486d-406d-a2fe-9282b23a2e20 service nova] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Detach interface failed, port_id=ab975b5c-f72d-4a8c-8b11-f916b880ed3a, reason: Instance 15cd8cea-8506-43da-b3c6-69412acbae96 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:16:46 user nova-compute[74721]: WARNING nova.volume.cinder [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Attachment 8afec487-635d-41de-8050-c739cb53f551 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8afec487-635d-41de-8050-c739cb53f551. (HTTP 404) (Request-ID: req-44cce732-4e04-4234-a81c-54edd6d76b2e)
Nov 02 23:16:46 user nova-compute[74721]: INFO nova.compute.manager [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] [instance: 15cd8cea-8506-43da-b3c6-69412acbae96] Took 0.04 seconds to detach 1 volumes for instance.
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:16:46 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Successfully updated port: 793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:16:47 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Deleted allocations for instance 15cd8cea-8506-43da-b3c6-69412acbae96
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-1cb19936-4c09-4b6f-a2c8-d4b3f5374e05 tempest-VolumesSnapshotTestJSON-372484288 tempest-VolumesSnapshotTestJSON-372484288-project-member] Lock "15cd8cea-8506-43da-b3c6-69412acbae96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.374s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Instance network_info: |[{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Start _get_guest_xml network_info=[{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:16:47 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:47 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-529454100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-529454100',id=38,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-89566yr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:45Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=3d3e49c8-ef70-4858-bf44-5d0b6be0816c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.objects.instance [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:16:47 user nova-compute[74721]:   <uuid>3d3e49c8-ef70-4858-bf44-5d0b6be0816c</uuid>
Nov 02 23:16:47 user nova-compute[74721]:   <name>instance-00000026</name>
Nov 02 23:16:47 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:16:47 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:16:47 user nova-compute[74721]:   <metadata>
Nov 02 23:16:47 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:16:47 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-529454100</nova:name>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:16:47</nova:creationTime>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:16:47 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:16:47 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:owner>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:16:47 user nova-compute[74721]:       </nova:owner>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:16:47 user nova-compute[74721]:       <nova:ports>
Nov 02 23:16:47 user nova-compute[74721]:         <nova:port uuid="793333a8-a6ee-4153-92f5-ddd5eec61381">
Nov 02 23:16:47 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 23:16:47 user nova-compute[74721]:         </nova:port>
Nov 02 23:16:47 user nova-compute[74721]:       </nova:ports>
Nov 02 23:16:47 user nova-compute[74721]:     </nova:instance>
Nov 02 23:16:47 user nova-compute[74721]:   </metadata>
Nov 02 23:16:47 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:16:47 user nova-compute[74721]:     <system>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="serial">3d3e49c8-ef70-4858-bf44-5d0b6be0816c</entry>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="uuid">3d3e49c8-ef70-4858-bf44-5d0b6be0816c</entry>
Nov 02 23:16:47 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:16:47 user nova-compute[74721]:     </system>
Nov 02 23:16:47 user nova-compute[74721]:   </sysinfo>
Nov 02 23:16:47 user nova-compute[74721]:   <os>
Nov 02 23:16:47 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:16:47 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:16:47 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:16:47 user nova-compute[74721]:   </os>
Nov 02 23:16:47 user nova-compute[74721]:   <features>
Nov 02 23:16:47 user nova-compute[74721]:     <acpi/>
Nov 02 23:16:47 user nova-compute[74721]:     <apic/>
Nov 02 23:16:47 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:16:47 user nova-compute[74721]:   </features>
Nov 02 23:16:47 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:16:47 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:16:47 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:16:47 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:16:47 user nova-compute[74721]:   </clock>
Nov 02 23:16:47 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:16:47 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:16:47 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:16:47 user nova-compute[74721]:   </cpu>
Nov 02 23:16:47 user nova-compute[74721]:   <devices>
Nov 02 23:16:47 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:16:47 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:16:47 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk"/>
Nov 02 23:16:47 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:16:47 user nova-compute[74721]:     </disk>
Nov 02 23:16:47 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:16:47 user nova-compute[74721]:       <mac address="fa:16:3e:bf:8e:fc"/>
Nov 02 23:16:47 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:47 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:16:47 user nova-compute[74721]:       <target dev="tap793333a8-a6"/>
Nov 02 23:16:47 user nova-compute[74721]:     </interface>
Nov 02 23:16:47 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:16:47 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/console.log" append="off"/>
Nov 02 23:16:47 user nova-compute[74721]:     </serial>
Nov 02 23:16:47 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:16:47 user nova-compute[74721]:     <video>
Nov 02 23:16:47 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:47 user nova-compute[74721]:     </video>
Nov 02 23:16:47 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:16:47 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:16:47 user nova-compute[74721]:     </rng>
Nov 02 23:16:47 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:16:47 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:16:47 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:16:47 user nova-compute[74721]:     </memballoon>
Nov 02 23:16:47 user nova-compute[74721]:   </devices>
Nov 02 23:16:47 user nova-compute[74721]: </domain>
Nov 02 23:16:47 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-529454100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-529454100',id=38,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-89566yr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:45Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=3d3e49c8-ef70-4858-bf44-5d0b6be0816c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG os_vif [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1f5d2ba-4639-5fc3-b1d3-609c1ea64e81', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap793333a8-a6, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap793333a8-a6, col_values=(('qos', UUID('8556f746-7934-417e-8361-140ed5b5355c')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap793333a8-a6, col_values=(('external_ids', {'iface-id': '793333a8-a6ee-4153-92f5-ddd5eec61381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:8e:fc', 'vm-uuid': '3d3e49c8-ef70-4858-bf44-5d0b6be0816c'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:47 user nova-compute[74721]: INFO os_vif [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6')
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:16:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Instance spawned successfully.
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:bf:8e:fc, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:16:48 user nova-compute[74721]: INFO nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Took 9.89 seconds to spawn the instance on the hypervisor.
Nov 02 23:16:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:48 user nova-compute[74721]: INFO nova.compute.manager [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Took 10.68 seconds to build instance.
Nov 02 23:16:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-661777db-842f-4318-b180-caabf3140c32 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.769s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-changed-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Refreshing instance network info cache due to event network-changed-793333a8-a6ee-4153-92f5-ddd5eec61381. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG nova.network.neutron [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Refreshing network info cache for port 793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:16:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.network.neutron [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updated VIF entry in instance network info cache for port 793333a8-a6ee-4153-92f5-ddd5eec61381. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.network.neutron [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] No waiting events found dispatching network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:49 user nova-compute[74721]: WARNING nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received unexpected event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa for instance with vm_state active and task_state None.
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] No waiting events found dispatching network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:49 user nova-compute[74721]: WARNING nova.compute.manager [req-0bc415aa-78a8-4f87-879c-abdd41b26793 req-0da380f3-093b-4ae2-a4ce-b4f8af0d3495 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received unexpected event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa for instance with vm_state active and task_state None.
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] No waiting events found dispatching network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:50 user nova-compute[74721]: WARNING nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received unexpected event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 for instance with vm_state building and task_state spawning.
Nov 02 23:16:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] No waiting events found dispatching network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:50 user nova-compute[74721]: WARNING nova.compute.manager [req-04b8c33c-62ed-4b41-954d-b10d052a7f53 req-714e510b-4de1-4954-93a6-19ec1114a25c service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received unexpected event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 for instance with vm_state building and task_state spawning.
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:16:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Instance spawned successfully.
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:51 user nova-compute[74721]: INFO nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 02 23:16:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:16:51 user nova-compute[74721]: INFO nova.compute.manager [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Took 7.78 seconds to build instance.
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bcc94f74-52f5-41a6-9dee-b2d1cb3663df tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.919s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:54 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:54 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.249256134033203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 185ac37f-d13e-4209-a195-a08acc8321c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:16:54 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:16:55 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:16:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:16:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Creating image(s)
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Ensure instance console log exists: /opt/stack/data/nova/instances/e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Start _get_guest_xml network_info=[{"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '7089bf83-d638-4b5c-8ca3-35a8d7522d6b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSbzQBdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce1933a7-2182-49ac-a246-b7bd2e08fe68', 'serial': 'ce1933a7-2182-49ac-a246-b7bd2e08fe68'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:16:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSbzQBdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:16:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:56 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:16:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:16:56 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:16:56 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2ed33-c778-4b8e-bf5c-e275ea873a84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:16:57 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a987dec7-b842-4075-8717-bf299d58082b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68] added
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a7275-479e-410b-b404-af41cb7e3a88]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c33cc5-f004-4bd4-9566-d40446d77fa8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSbzQBdV {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSbzQBdV" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd9c72-4355-4f4f-b472-fdef9a4a3c0b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSbzQBdV'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d065d54-768b-4bb8-b959-892bafbfecb0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ce6b4-a0bb-4b5a-afa2-9dfae6eb5c5c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44907f27-e169-447b-8185-0cf19bf440bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260]
Nov 02 23:16:57 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260] successful.
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c0739-0ec0-4f9f-9e50-e4b30e7608ba]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c689a-aaf1-4a56-806f-a920a6421ed0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:16:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473f58a-fd6d-432a-a6f3-08e1ba3800cc]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSbzQBdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:16:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23533396233613561', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533396233613561', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1554207123',display_name='tempest-TestVolumeBootPattern-server-1554207123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1554207123',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-d6cw9zlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:29Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:16:58 user nova-compute[74721]:   <uuid>e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7</uuid>
Nov 02 23:16:58 user nova-compute[74721]:   <name>instance-00000023</name>
Nov 02 23:16:58 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:16:58 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:16:58 user nova-compute[74721]:   <metadata>
Nov 02 23:16:58 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:16:58 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:16:58 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-server-1554207123</nova:name>
Nov 02 23:16:58 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:16:56</nova:creationTime>
Nov 02 23:16:58 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:16:58 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:16:58 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:16:58 user nova-compute[74721]:       <nova:owner>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:16:58 user nova-compute[74721]:       </nova:owner>
Nov 02 23:16:58 user nova-compute[74721]:       <nova:ports>
Nov 02 23:16:58 user nova-compute[74721]:         <nova:port uuid="92ea5c04-9466-4d5d-8994-6a4a53d5318b">
Nov 02 23:16:58 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:16:58 user nova-compute[74721]:         </nova:port>
Nov 02 23:16:58 user nova-compute[74721]:       </nova:ports>
Nov 02 23:16:58 user nova-compute[74721]:     </nova:instance>
Nov 02 23:16:58 user nova-compute[74721]:   </metadata>
Nov 02 23:16:58 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:16:58 user nova-compute[74721]:     <system>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="serial">e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7</entry>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="uuid">e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7</entry>
Nov 02 23:16:58 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:16:58 user nova-compute[74721]:     </system>
Nov 02 23:16:58 user nova-compute[74721]:   </sysinfo>
Nov 02 23:16:58 user nova-compute[74721]:   <os>
Nov 02 23:16:58 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:16:58 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:16:58 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:16:58 user nova-compute[74721]:   </os>
Nov 02 23:16:58 user nova-compute[74721]:   <features>
Nov 02 23:16:58 user nova-compute[74721]:     <acpi/>
Nov 02 23:16:58 user nova-compute[74721]:     <apic/>
Nov 02 23:16:58 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:16:58 user nova-compute[74721]:   </features>
Nov 02 23:16:58 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:16:58 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:16:58 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:16:58 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:16:58 user nova-compute[74721]:   </clock>
Nov 02 23:16:58 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:16:58 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:16:58 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:16:58 user nova-compute[74721]:   </cpu>
Nov 02 23:16:58 user nova-compute[74721]:   <devices>
Nov 02 23:16:58 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:16:58 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:16:58 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:16:58 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:16:58 user nova-compute[74721]:       <serial>ce1933a7-2182-49ac-a246-b7bd2e08fe68</serial>
Nov 02 23:16:58 user nova-compute[74721]:     </disk>
Nov 02 23:16:58 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:16:58 user nova-compute[74721]:       <mac address="fa:16:3e:e1:07:76"/>
Nov 02 23:16:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:58 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:16:58 user nova-compute[74721]:       <target dev="tap92ea5c04-94"/>
Nov 02 23:16:58 user nova-compute[74721]:     </interface>
Nov 02 23:16:58 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:16:58 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7/console.log" append="off"/>
Nov 02 23:16:58 user nova-compute[74721]:     </serial>
Nov 02 23:16:58 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:16:58 user nova-compute[74721]:     <video>
Nov 02 23:16:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:16:58 user nova-compute[74721]:     </video>
Nov 02 23:16:58 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:16:58 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:16:58 user nova-compute[74721]:     </rng>
Nov 02 23:16:58 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:16:58 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:16:58 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:16:58 user nova-compute[74721]:     </memballoon>
Nov 02 23:16:58 user nova-compute[74721]:   </devices>
Nov 02 23:16:58 user nova-compute[74721]: </domain>
Nov 02 23:16:58 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1554207123',display_name='tempest-TestVolumeBootPattern-server-1554207123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1554207123',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-d6cw9zlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:29Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG os_vif [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58ab461e-bba1-5785-8454-1201982e7335', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92ea5c04-94, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92ea5c04-94, col_values=(('qos', UUID('319a8d17-2721-44c8-8811-a24e187dbd87')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92ea5c04-94, col_values=(('external_ids', {'iface-id': '92ea5c04-9466-4d5d-8994-6a4a53d5318b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:07:76', 'vm-uuid': 'e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:58 user nova-compute[74721]: INFO os_vif [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94')
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:16:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:e1:07:76, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:16:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] No waiting events found dispatching network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:16:59 user nova-compute[74721]: WARNING nova.compute.manager [req-a63bfcde-8740-4032-8712-6b8685d0f3a6 req-29daa372-dca7-4516-b03e-69a02f2b8f16 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received unexpected event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b for instance with vm_state building and task_state spawning.
Nov 02 23:17:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:17:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:17:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Instance spawned successfully.
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] No waiting events found dispatching network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:17:02 user nova-compute[74721]: WARNING nova.compute.manager [req-421c8884-8907-4431-b012-4002cb963ae1 req-80b27e5c-b13f-4683-9119-b3648d1f5b56 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received unexpected event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b for instance with vm_state building and task_state spawning.
Nov 02 23:17:02 user nova-compute[74721]: INFO nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 02 23:17:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:17:02 user nova-compute[74721]: INFO nova.compute.manager [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Took 33.56 seconds to build instance.
Nov 02 23:17:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d806d2cd-386b-4a1f-9f11-64357a14a287 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.660s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:04 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 185ac37f-d13e-4209-a195-a08acc8321c4 is timed out.
Nov 02 23:17:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully detached device vdb from instance 185ac37f-d13e-4209-a195-a08acc8321c4 from the live domain config.
Nov 02 23:17:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHvrbfCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:17:04 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e1d933-ab50-44c0-8052-e48be5195ed8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:17:04 user nova-compute[74721]: No targets found.
Nov 02 23:17:04 user nova-compute[74721]: iSNS:
Nov 02 23:17:04 user nova-compute[74721]: No targets found.
Nov 02 23:17:04 user nova-compute[74721]: STATIC:
Nov 02 23:17:04 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5
Nov 02 23:17:04 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:17:04 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:17:04 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68
Nov 02 23:17:04 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:17:04 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:17:04 user nova-compute[74721]: FIRMWARE:
Nov 02 23:17:04 user nova-compute[74721]: No targets found.
Nov 02 23:17:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:17:04 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:17:04 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1f584-76d7-41be-a7ad-fe4844f67013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767722a-14bd-4fe5-9a42-564cffddfa02]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:17:04 user nova-compute[74721]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 (non-flash)
Nov 02 23:17:04 user nova-compute[74721]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf0472b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce650ed3-ea48-4a9d-9848-5b006eb2f5b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f825bbe-2bc9-4a65-a69e-877f6b9fa0cd]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ac5f2-441f-4ba4-9fe5-0b253c2b9e6c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf414173-93b1-4f7d-b579-e0a656c9090e]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[84af0762-4f3c-41a8-b9dd-97e6e3a56982]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f00947-2145-4730-af9c-82882df142e4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260]
Nov 02 23:17:04 user nova-compute[74721]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5, portal: 172.16.0.220,3260] successful.
Nov 02 23:17:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117a437b-3a7a-47ef-be80-199a6ec97be5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c32e36-9d08-4f01-bfe6-1ec764730dc4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== disconnect_volume: return (326ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:17:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:17:05 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5bb33ca3-e7fb-42e5-9ba1-1e99ae13235c tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.456s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG nova.objects.instance [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:12 user nova-compute[74721]: INFO nova.compute.manager [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attaching volume b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 to /dev/vdb
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be0b96a-5681-4545-b689-e6166fd39764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaddb1a8-a955-407b-9e1f-d6d4a3380620]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7586d1-3a9e-4b1e-aa13-58fb63c73f0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[47371585-00aa-4ed7-b004-b91b1c72c951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:17:12 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:17:12 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de278afd-d854-4a3c-bd19-fd7f09e51007]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG os_brick.utils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:17:12 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating existing volume attachment record: 34a1e285-dcb8-4f11-a9a7-3a1866088d65 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:17:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylJmQfcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:17:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:17:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:17:33 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5d457-b361-4263-aa4f-553adffd530d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:17:33 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f86e3-2062-407c-b6b5-088884fdb6a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0] added
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d837ca-2973-4638-9101-771b8f5cac9a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b08bb-0e35-4e88-8cc3-de343d4b5ed5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylJmQfcH {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylJmQfcH" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9fd19f-276e-4b31-bbd0-ee1375c099f0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylJmQfcH'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db8c8c-c41c-497e-a922-a55f964dc3eb]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614ae89-5ed7-431e-98e6-4587ba94eacc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce49064-3caa-41ff-b197-3ed73b46d54c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260]
Nov 02 23:17:33 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672965f-e1c5-4995-a40d-8fea1445c3c1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[00470201-1821-4b91-a1aa-1addb218acd1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)
Nov 02 23:17:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331fd34-fe60-489a-af21-8caddd18514b]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:17:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylJmQfcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23861643461383737', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861643461383737', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:17:34 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:17:34 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:17:34 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:17:34 user nova-compute[74721]:   <serial>b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0</serial>
Nov 02 23:17:34 user nova-compute[74721]: </disk>
Nov 02 23:17:34 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:17:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] No VIF found with MAC fa:16:3e:ac:49:ba, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:17:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-bbaded2d-1f0a-4aec-a4ea-8c0a1dfda04a tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.612s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:37 user nova-compute[74721]: INFO nova.compute.manager [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Detaching volume b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0
Nov 02 23:17:37 user nova-compute[74721]: INFO nova.virt.block_device [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Attempting to driver detach volume b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 from mountpoint /dev/vdb
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Attempting to detach device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:17:37 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:17:37 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:17:37 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:17:37 user nova-compute[74721]:   <serial>b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0</serial>
Nov 02 23:17:37 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:17:37 user nova-compute[74721]: </disk>
Nov 02 23:17:37 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:17:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the persistent domain config.
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:17:37 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:17:37 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:17:37 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:17:37 user nova-compute[74721]:   <serial>b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0</serial>
Nov 02 23:17:37 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:17:37 user nova-compute[74721]: </disk>
Nov 02 23:17:37 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:17:37 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:17:38 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:17:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:17:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:17:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:39 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:17:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:44 user nova-compute[74721]: INFO nova.compute.manager [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Terminating instance
Nov 02 23:17:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Instance destroyed successfully.
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.objects.instance [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'resources' on Instance uuid 185ac37f-d13e-4209-a195-a08acc8321c4 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646288978',display_name='tempest-TestMinimumBasicScenario-server-646288978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646288978',id=30,image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJ1XxMu9t4QIKUSHowhceXcQP1ZGXX7rPq2WPW3UC0BpeKCVGeLLLQdf4cU9/zrXeDzWWu9RjiQh874Zh7J64Vvz1YDdoNPDl9Uu5Y7gbVcNQm7B4QMcdOhfY4vmI3xA==',key_name='tempest-TestMinimumBasicScenario-1643399354',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-k8w173o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3fdfb82a-ec4f-4bbc-8c4c-5585595dd577',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:15:00Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=185ac37f-d13e-4209-a195-a08acc8321c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "address": "fa:16:3e:ac:50:65", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acdf3d-6e", "ovs_interfaceid": "08acdf3d-6e0a-4b6f-9b4c-88731e6c0468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG os_vif [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-483f721b-d64d-48a4-bd85-0652647a5654 req-45cc6dc0-5fb3-4eca-9b63-9712e974680d service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-unplugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08acdf3d-6e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d49b51a3-9a9c-4511-bd5a-61eb36ff2b27) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: INFO os_vif [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:65,bridge_name='br-int',has_traffic_filtering=True,id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acdf3d-6e')
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Deleting instance files /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4_del
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Deletion of /opt/stack/data/nova/instances/185ac37f-d13e-4209-a195-a08acc8321c4_del complete
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.compute.manager [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Took 0.52 seconds to deallocate network for instance.
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1706d3d-0230-4a46-ab25-e17cda65d47b req-f81b64fa-9ff9-4a30-aa90-ad6995788592 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-deleted-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:17:45 user nova-compute[74721]: INFO nova.compute.manager [req-b1706d3d-0230-4a46-ab25-e17cda65d47b req-f81b64fa-9ff9-4a30-aa90-ad6995788592 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Neutron deleted interface 08acdf3d-6e0a-4b6f-9b4c-88731e6c0468; detaching it from the instance and deleting it from the info cache
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.network.neutron [req-b1706d3d-0230-4a46-ab25-e17cda65d47b req-f81b64fa-9ff9-4a30-aa90-ad6995788592 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-b1706d3d-0230-4a46-ab25-e17cda65d47b req-f81b64fa-9ff9-4a30-aa90-ad6995788592 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Detach interface failed, port_id=08acdf3d-6e0a-4b6f-9b4c-88731e6c0468, reason: Instance 185ac37f-d13e-4209-a195-a08acc8321c4 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:46 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:17:46 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:17:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:46 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Deleted allocations for instance 185ac37f-d13e-4209-a195-a08acc8321c4
Nov 02 23:17:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00352c5e-a088-4070-a000-7d34106951c0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "185ac37f-d13e-4209-a195-a08acc8321c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:17:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] Acquiring lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] Lock "185ac37f-d13e-4209-a195-a08acc8321c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] No waiting events found dispatching network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:17:47 user nova-compute[74721]: WARNING nova.compute.manager [req-d568b2cb-d985-49cd-b6ec-18e16425291c req-cea06e86-3877-4b89-b17f-a223c3153cb3 service nova] [instance: 185ac37f-d13e-4209-a195-a08acc8321c4] Received unexpected event network-vif-plugged-08acdf3d-6e0a-4b6f-9b4c-88731e6c0468 for instance with vm_state deleted and task_state None.
Nov 02 23:17:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:17:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:17:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7750MB free_disk=25.201244354248047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:17:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:17:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:17:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:17:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 is timed out.
Nov 02 23:17:58 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully detached device vdb from instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 from the live domain config.
Nov 02 23:17:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylJmQfcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:17:58 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32b432-8ae9-402e-b843-74a86d24cc25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:17:58 user nova-compute[74721]: No targets found.
Nov 02 23:17:58 user nova-compute[74721]: iSNS:
Nov 02 23:17:58 user nova-compute[74721]: No targets found.
Nov 02 23:17:58 user nova-compute[74721]: STATIC:
Nov 02 23:17:58 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0
Nov 02 23:17:58 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:17:58 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:17:58 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68
Nov 02 23:17:58 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:17:58 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:17:58 user nova-compute[74721]: FIRMWARE:
Nov 02 23:17:58 user nova-compute[74721]: No targets found.
Nov 02 23:17:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:17:58 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:17:58 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92201d6b-7d13-493f-a8f7-400e823503dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae1922-8eee-45b7-b3de-e72abf193946]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:58 user nova-compute[74721]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)
Nov 02 23:17:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:17:58 user nova-compute[74721]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 (non-flash)
Nov 02 23:17:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c255c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf98295c-2d21-440a-b02d-77db2a12d2ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086e329-f3f3-46ac-ab79-63c79cee2a7f]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3182dfc9-c491-4714-9cea-4984d3d3f6f0]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eba345-11ee-4a5f-8a84-d9d9ce394c8f]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[331e007f-2abd-4c61-b5af-30c9c795b9be]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997982f-6fbc-4cf8-9f15-046df67fbb46]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260]
Nov 02 23:17:58 user nova-compute[74721]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:17:58 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e74d53-7524-4a96-8ea3-ac1f1d9d09a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ed95c2-a56e-4372-a01f-7cbd35873fd6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] <== disconnect_volume: return (311ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:17:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:17:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'flavor' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:17:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e70b74ae-36ad-423d-a168-15b68b233281 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:13 user nova-compute[74721]: INFO nova.compute.manager [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Unshelving
Nov 02 23:18:13 user nova-compute[74721]: INFO nova.virt.block_device [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Booting with volume 1f8b09d0-a64a-4b35-af35-73fd20986f27 at /dev/vdc
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e475c52-5fe4-4250-b608-99e59f829f9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c11b0a-2b50-4335-b8a7-303e2df1d288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[48210a45-dad4-4ab3-abfe-af3655de6273]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb337c-c51a-4eed-a695-8e899b39f390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:13 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:18:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa77b30-6854-4092-875b-635de703f50f]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:13 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating existing volume attachment record: 4ef1bc3e-861c-4e62-9971-1543fde404e1 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:18:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:15 user nova-compute[74721]: INFO nova.compute.manager [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Unshelving
Nov 02 23:18:16 user nova-compute[74721]: INFO nova.virt.block_device [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Booting with volume ecbdff50-f861-4bf2-a69a-7366d21b51a0 at /dev/vda
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.utils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c98c39-6a29-4d93-b4f3-654927f82808]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a857b72a-a60d-4559-ac75-48c7da3f8cf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7405acd0-01fa-41a2-b2be-f2ee97eb2d28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e34676-206a-4da2-a0ce-48f05fb4cf26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:16 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:18:16 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3a433-2fff-47ef-a0fb-e2ff8ca87f3e]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG os_brick.utils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:16 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating existing volume attachment record: 838d7f0b-72ec-4d4e-af35-f9768e6a6e53 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:18 user nova-compute[74721]: INFO nova.compute.manager [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Terminating instance
Nov 02 23:18:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:18:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-unplugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] No waiting events found dispatching network-vif-unplugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-5b3e1516-1071-41b6-8279-b6ca87e27735 req-f68a5cad-db19-49ea-8fe2-1d68c465d176 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-unplugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:18:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Instance destroyed successfully.
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.objects.instance [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1554207123',display_name='tempest-TestVolumeBootPattern-server-1554207123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1554207123',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-d6cw9zlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:17:02Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "address": "fa:16:3e:e1:07:76", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92ea5c04-94", "ovs_interfaceid": "92ea5c04-9466-4d5d-8994-6a4a53d5318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_vif [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92ea5c04-94, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=319a8d17-2721-44c8-8811-a24e187dbd87) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:19 user nova-compute[74721]: INFO os_vif [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:07:76,bridge_name='br-int',has_traffic_filtering=True,id=92ea5c04-9466-4d5d-8994-6a4a53d5318b,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92ea5c04-94')
Nov 02 23:18:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSbzQBdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:19 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd00382-3ae4-43e6-8eb8-ffeff29f8cf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:18:19 user nova-compute[74721]: No targets found.
Nov 02 23:18:19 user nova-compute[74721]: iSNS:
Nov 02 23:18:19 user nova-compute[74721]: No targets found.
Nov 02 23:18:19 user nova-compute[74721]: STATIC:
Nov 02 23:18:19 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68
Nov 02 23:18:19 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:18:19 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:18:19 user nova-compute[74721]: FIRMWARE:
Nov 02 23:18:19 user nova-compute[74721]: No targets found.
Nov 02 23:18:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:18:19 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:18:19 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fcf091-b036-4e6d-98d9-62d1251c8df9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1916519-aa9d-4a5d-94ea-de04df854699]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:18:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 (non-flash)
Nov 02 23:18:19 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf2419a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb592f-7ea8-4874-86b3-6cbb813d85c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4fa70e-f404-4c99-a92e-032b4cae294d]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:18:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[97701c6d-4ff6-43de-af73-b8945d59e814]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.078s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceaeda5-d76f-4573-9008-3abf04ebadcb]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_41d9eff4', '/dev/disk/by-id/scsi-1SCST_BIO41d9eff4-539b3a5aa2162aa9', '/dev/disk/by-id/scsi-23533396233613561') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602355e-2881-43aa-bee7-f5ae3a476e93]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01749f3-6e8e-47a6-a44f-a052630c3037]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea60583-adfd-43a3-854b-768efbaff9d6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260]
Nov 02 23:18:20 user nova-compute[74721]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68, portal: 172.16.0.220,3260] successful.
Nov 02 23:18:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1933a7-2182-49ac-a246-b7bd2e08fe68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a791dd7-8ff6-4b03-a8cd-2774f65fb625]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (357ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:18:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Deleting instance files /opt/stack/data/nova/instances/e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7_del
Nov 02 23:18:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Deletion of /opt/stack/data/nova/instances/e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7_del complete
Nov 02 23:18:20 user nova-compute[74721]: INFO nova.compute.manager [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:20 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Took 0.49 seconds to deallocate network for instance.
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-b223fa90-b891-4a0c-8aba-b92dce43b69b req-1b563647-a02d-434c-b9dd-d0e5ed5bc995 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-deleted-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing instance network info cache due to event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:20 user nova-compute[74721]: DEBUG nova.network.neutron [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] Acquiring lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] No waiting events found dispatching network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:21 user nova-compute[74721]: WARNING nova.compute.manager [req-821343ac-ef28-4ad1-8810-5df52069e207 req-fa481dfe-81f0-4496-ab73-93de7cb5f117 service nova] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Received unexpected event network-vif-plugged-92ea5c04-9466-4d5d-8994-6a4a53d5318b for instance with vm_state active and task_state deleting.
Nov 02 23:18:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updated VIF entry in instance network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e4961f6f-14df-4830-bb6d-3d7408eda74c req-838351c5-2ad0-4ddf-9ee6-b1838926d821 service nova] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-changed-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Refreshing instance network info cache due to event network-changed-bca8d68e-726f-40ff-af27-4af38ace54aa. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] Acquiring lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] Acquired lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Refreshing network info cache for port bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updated VIF entry in instance network info cache for port bca8d68e-726f-40ff-af27-4af38ace54aa. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updating instance_info_cache with network_info: [{"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-72ba1ede-9e8d-44e2-adc6-c041086d5e75 req-e38d865f-bb36-4aac-ad88-cb55779bb778 service nova] Releasing lock "refresh_cache-7f62294b-7c3c-4461-aa87-d70b65ae1528" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'flavor' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:33 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_requests' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'numa_topology' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:18:34 user nova-compute[74721]: INFO nova.compute.claims [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Claim successful on node user
Nov 02 23:18:34 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:34 user nova-compute[74721]: INFO nova.network.neutron [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:34 user nova-compute[74721]: INFO nova.compute.manager [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Attaching volume ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 to /dev/vdb
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.utils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5dc994-ac16-4520-993f-9931daed92e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80ad7f-0a7f-469f-b497-5d2b7d5c1e2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b366d-8b07-491c-b6e1-40eb027e7700]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d63ee-baf4-4397-b330-a55fe54d3e66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:34 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:18:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a936a-3242-43d4-b23c-64b1e123f6e8]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG os_brick.utils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:34 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating existing volume attachment record: a54285fc-bb4d-4007-981e-16e27ffb33c4 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:18:35 user nova-compute[74721]: INFO nova.compute.manager [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] instance snapshotting
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:18:35 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Beginning live snapshot process
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing instance network info cache due to event network-changed-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] Acquiring lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:18:35 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Creating image(s)
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] Acquired lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.network.neutron [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Refreshing network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG nova.objects.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<ee1c3ce6-0281-46ae-98c3-df163d075533> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json -f qcow2" returned: 0 in 1.518s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG nova.virt.images [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] 3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.part /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.212s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059.delta 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059.delta 1073741824" returned: 0 in 0.093s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 23:18:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updated VIF entry in instance network info cache for port d2bd5cff-877a-4067-a204-8ab9bf8bf6a9. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG nova.network.neutron [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-246ae652-670c-43df-b3fb-87b07bed16d4 req-1afc8146-2c4a-49cf-acf7-5117c43be0f6 service nova] Releasing lock "refresh_cache-ee1c3ce6-0281-46ae-98c3-df163d075533" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.part /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.converted" returned: 0 in 0.338s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:37 user nova-compute[74721]: INFO nova.compute.manager [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Took 17.01 seconds to detach 1 volumes for instance.
Nov 02 23:18:37 user nova-compute[74721]: DEBUG nova.compute.manager [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7] Deleting volume: ce1933a7-2182-49ac-a246-b7bd2e08fe68 {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.089s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json" returned: 0 in 0.226s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03,backing_fmt=raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03,backing_fmt=raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk 1073741824" returned: 0 in 0.058s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "c75aacbe33fc3a2c6e81da4218a44bf1af541c03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] COPY block job progress, current cursor: 3145728 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'migration_context' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.objects.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<ee1c3ce6-0281-46ae-98c3-df163d075533> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Rebasing disk image.
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e -F raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] COPY block job progress, current cursor: 16318464 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:18:38 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.905s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.907s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'pci_requests' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'numa_topology' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:18:39 user nova-compute[74721]: INFO nova.compute.claims [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Claim successful on node user
Nov 02 23:18:39 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-89e3cc51-5a36-4ede-be8c-4b974d2343d5 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e5eebd90-c576-4ff4-a0fb-aacf24f7dfb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.399s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:18:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059.delta /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:39 user nova-compute[74721]: INFO nova.network.neutron [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating port 894be900-e9b5-4bab-85e3-e97ea45970fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059.delta /opt/stack/data/nova/instances/snapshots/tmptwq7ra2e/1ef795a5257d4837a8f46e59ce815059" returned: 0 in 0.354s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:39 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Snapshot extracted, beginning image upload
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.289s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing instance network info cache due to event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:18:40 user nova-compute[74721]: INFO nova.compute.claims [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Claim successful on node user
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:40 user nova-compute[74721]: INFO nova.compute.manager [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Attaching volume f167204e-9df4-45de-abea-005cc12ae28a to /dev/vdb
Nov 02 23:18:40 user nova-compute[74721]: DEBUG os_brick.utils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[01923e55-073f-45e3-a763-94c96c850277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d98f3c-1dc3-4f9b-977e-9ef1fe5c8928]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac6a24-0562-4a45-aa9f-2cfb9591c272]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdeb925-3ba2-47fb-b61a-ebcb53df6369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b7c88-625f-4913-8e94-ef6fbac29e29]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.utils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updating existing volume attachment record: 23ae4fff-bbb8-407a-8b7c-34364ab3e267 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:18:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Creating image(s)
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Ensure instance console log exists: /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start _get_guest_xml network_info=[{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '838d7f0b-72ec-4d4e-af35-f9768e6a6e53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd043208f-7d0f-4017-8e4b-f3c28de3a88f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'serial': 'ecbdff50-f861-4bf2-a69a-7366d21b51a0'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'vcpu_model' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.objects.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Object Instance<d043208f-7d0f-4017-8e4b-f3c28de3a88f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:18:41 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf52b12-a429-4e55-a812-691d13728138]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:18:41 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41382f56-cc51-40f4-9283-233cf1257bd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0] added
Nov 02 23:18:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5d650-8df1-4307-b55e-049898c7971e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e -F raw /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk" returned: 0 in 2.822s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Ensure instance console log exists: /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start _get_guest_xml network_info=[{"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cc0d46c724654242376d2a72502c77b3',container_format='bare',created_at=2023-11-02T23:16:21Z,direct_url=<?>,disk_format='qcow2',id=3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-774356443-shelved',owner='eca645902e8740fd909d3d90bbc62b01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:16:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '4ef1bc3e-861c-4e62-9971-1543fde404e1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeXwjhq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ee1c3ce6-0281-46ae-98c3-df163d075533', 'attached_at': '', 'detached_at': '', 'volume_id': '1f8b09d0-a64a-4b35-af35-73fd20986f27', 'serial': '1f8b09d0-a64a-4b35-af35-73fd20986f27'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b2288-4a89-4f49-8b38-f0f7f4cc319b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlaGkTVx {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:41 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlaGkTVx" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[829653df-9ed1-4eec-8e80-e8433370d52a]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JlaGkTVx'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cc0d46c724654242376d2a72502c77b3',container_format='bare',created_at=2023-11-02T23:16:21Z,direct_url=<?>,disk_format='qcow2',id=3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-774356443-shelved',owner='eca645902e8740fd909d3d90bbc62b01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:16:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb923da-411d-4c1a-b2f7-f3fe57734c46]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.objects.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<ee1c3ce6-0281-46ae-98c3-df163d075533> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeXwjhq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e355a39-ea80-4e87-815b-e733555bff79]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:18:41 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 23:18:41 user nova-compute[74721]:  {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:18:41 user nova-compute[74721]: WARNING os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 23:18:41 user nova-compute[74721]: 
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5956733-8207-4f70-8fba-93f7e0a65768]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]
Nov 02 23:18:41 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:18:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.policy [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dc6f5e5ea0d4089998a6b8bff41c488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6216758d9b4e8abdb1840710239900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682cef0-beae-45af-95e9-293839b8ff0f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9becb878-0980-47fc-ae79-a8d4171e6b28]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:18:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Creating image(s)
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "/opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "/opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "/opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bff6b6-375d-4b2b-8166-bb19515bdedb]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:18:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23865663539393862', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663539393862', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.171s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:18:42 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:18:42 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Successfully created port: 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa11a01-76bd-4764-96ed-b74f9317a6e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:18:42 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1797066865',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:18:16Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'pci_devices' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75845068-9329-402f-8a9f-c597d98ec503]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27] added
Nov 02 23:18:42 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.objects.base [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Object Instance<d043208f-7d0f-4017-8e4b-f3c28de3a88f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:18:42 user nova-compute[74721]:   <uuid>d043208f-7d0f-4017-8e4b-f3c28de3a88f</uuid>
Nov 02 23:18:42 user nova-compute[74721]:   <name>instance-00000022</name>
Nov 02 23:18:42 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:18:42 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:18:42 user nova-compute[74721]:   <metadata>
Nov 02 23:18:42 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:18:42 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:18:42 user nova-compute[74721]:       <nova:name>tempest-TestShelveInstance-server-1774225187</nova:name>
Nov 02 23:18:42 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:18:41</nova:creationTime>
Nov 02 23:18:42 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:18:42 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:18:42 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:18:42 user nova-compute[74721]:       <nova:owner>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:user uuid="ace8a1614dbb40f1abbcec0433775de1">tempest-TestShelveInstance-1226338228-project-member</nova:user>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:project uuid="74a24963e0da47008a77678475eae00c">tempest-TestShelveInstance-1226338228</nova:project>
Nov 02 23:18:42 user nova-compute[74721]:       </nova:owner>
Nov 02 23:18:42 user nova-compute[74721]:       <nova:ports>
Nov 02 23:18:42 user nova-compute[74721]:         <nova:port uuid="894be900-e9b5-4bab-85e3-e97ea45970fc">
Nov 02 23:18:42 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 23:18:42 user nova-compute[74721]:         </nova:port>
Nov 02 23:18:42 user nova-compute[74721]:       </nova:ports>
Nov 02 23:18:42 user nova-compute[74721]:     </nova:instance>
Nov 02 23:18:42 user nova-compute[74721]:   </metadata>
Nov 02 23:18:42 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:18:42 user nova-compute[74721]:     <system>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="serial">d043208f-7d0f-4017-8e4b-f3c28de3a88f</entry>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="uuid">d043208f-7d0f-4017-8e4b-f3c28de3a88f</entry>
Nov 02 23:18:42 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:18:42 user nova-compute[74721]:     </system>
Nov 02 23:18:42 user nova-compute[74721]:   </sysinfo>
Nov 02 23:18:42 user nova-compute[74721]:   <os>
Nov 02 23:18:42 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:18:42 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:18:42 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:18:42 user nova-compute[74721]:   </os>
Nov 02 23:18:42 user nova-compute[74721]:   <features>
Nov 02 23:18:42 user nova-compute[74721]:     <acpi/>
Nov 02 23:18:42 user nova-compute[74721]:     <apic/>
Nov 02 23:18:42 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:18:42 user nova-compute[74721]:   </features>
Nov 02 23:18:42 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:18:42 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:18:42 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:18:42 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:18:42 user nova-compute[74721]:   </clock>
Nov 02 23:18:42 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:18:42 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:18:42 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:18:42 user nova-compute[74721]:   </cpu>
Nov 02 23:18:42 user nova-compute[74721]:   <devices>
Nov 02 23:18:42 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:18:42 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:18:42 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:18:42 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:18:42 user nova-compute[74721]:       <serial>ecbdff50-f861-4bf2-a69a-7366d21b51a0</serial>
Nov 02 23:18:42 user nova-compute[74721]:     </disk>
Nov 02 23:18:42 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:18:42 user nova-compute[74721]:       <mac address="fa:16:3e:2e:d9:13"/>
Nov 02 23:18:42 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:42 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:18:42 user nova-compute[74721]:       <target dev="tap894be900-e9"/>
Nov 02 23:18:42 user nova-compute[74721]:     </interface>
Nov 02 23:18:42 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:18:42 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f/console.log" append="off"/>
Nov 02 23:18:42 user nova-compute[74721]:     </serial>
Nov 02 23:18:42 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:18:42 user nova-compute[74721]:     <video>
Nov 02 23:18:42 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:42 user nova-compute[74721]:     </video>
Nov 02 23:18:42 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:18:42 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:18:42 user nova-compute[74721]:     </rng>
Nov 02 23:18:42 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:18:42 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:18:42 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:18:42 user nova-compute[74721]:     </memballoon>
Nov 02 23:18:42 user nova-compute[74721]:   </devices>
Nov 02 23:18:42 user nova-compute[74721]: </domain>
Nov 02 23:18:42 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1797066865',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:18:16Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG os_vif [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68a0ffbe-c333-54a5-97a0-6922413b3672', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fc3d48-14c8-4d27-8246-2802c486a909]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.part --force-share --output=json" returned: 0 in 0.305s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.virt.images [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] 4bd92455-f456-4c45-b677-7630f87d0e7f was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.part /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e7d52a-274c-4d0d-83b6-68886dd89e5c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap894be900-e9, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap894be900-e9, col_values=(('qos', UUID('ecfbea5b-5500-43cc-a64b-49ef37873603')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap894be900-e9, col_values=(('external_ids', {'iface-id': '894be900-e9b5-4bab-85e3-e97ea45970fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:d9:13', 'vm-uuid': 'd043208f-7d0f-4017-8e4b-f3c28de3a88f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZeXwjhq {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZeXwjhq" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0450a8-d470-4ca6-8f3d-337038a06cf1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZeXwjhq'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:43 user nova-compute[74721]: INFO os_vif [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9')
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb89299-47f3-40b1-80b2-fa7b9618fce7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c90cc2e-d69c-4647-9b6d-3da64f213eed]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.part /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.converted" returned: 0 in 0.235s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f3ad66-ab1c-4118-a047-ff9bd3495378]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260]
Nov 02 23:18:43 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260] successful.
Nov 02 23:18:43 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] No VIF found with MAC fa:16:3e:2e:d9:13, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.079s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2bf2d6-bdfd-43f7-8852-06e377a11076]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea6ece-ca8c-4ae8-b243-90a59d6b01dd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:18:43 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.592s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab76233-476a-4775-89d5-6c8a488cd1ff]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeXwjhq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6.converted --force-share --output=json" returned: 0 in 0.284s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.703s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updated VIF entry in instance network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bf676c10-8de0-4695-9730-235bc45a8ed3 req-8ea52894-7704-4e96-bbdb-1586b33742d6 service nova] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json" returned: 0 in 0.232s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Successfully updated port: 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing instance network info cache due to event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:18:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:18:44 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Snapshot image upload complete
Nov 02 23:18:44 user nova-compute[74721]: INFO nova.compute.manager [None req-5d63fca2-fdce-471a-93fb-dd7a95fe78ca tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Took 8.88 seconds to snapshot the instance on the hypervisor.
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json" returned: 0 in 0.216s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6,backing_fmt=raw /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6,backing_fmt=raw /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk 1073741824" returned: 0 in 0.049s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "294d6a8e6d2f34018169c6b6968606fdc69505f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6787d62-b5f6-41a6-b1ea-ea260bd25e29 req-555e7cf9-2842-4273-8d45-e00fa13b88d7 service nova] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Cannot resize image /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.675s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] <== connect_volume: return (2845ms) {'type': 'block', 'scsi_wwn': '23565336566666139', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565336566666139', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-688781644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:16:25.771896',shelved_host='user',shelved_image_id='3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_devices' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.objects.base [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<ee1c3ce6-0281-46ae-98c3-df163d075533> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:18:44 user nova-compute[74721]:   <uuid>ee1c3ce6-0281-46ae-98c3-df163d075533</uuid>
Nov 02 23:18:44 user nova-compute[74721]:   <name>instance-00000021</name>
Nov 02 23:18:44 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:18:44 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:18:44 user nova-compute[74721]:   <metadata>
Nov 02 23:18:44 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:18:44 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-774356443</nova:name>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:18:41</nova:creationTime>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:18:44 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:owner>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:user uuid="8116c488ed184fd2ace8fdbe0845d033">tempest-AttachVolumeShelveTestJSON-110193585-project-member</nova:user>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:project uuid="eca645902e8740fd909d3d90bbc62b01">tempest-AttachVolumeShelveTestJSON-110193585</nova:project>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:owner>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:root type="image" uuid="3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565"/>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:ports>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:port uuid="d2bd5cff-877a-4067-a204-8ab9bf8bf6a9">
Nov 02 23:18:44 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 23:18:44 user nova-compute[74721]:         </nova:port>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:ports>
Nov 02 23:18:44 user nova-compute[74721]:     </nova:instance>
Nov 02 23:18:44 user nova-compute[74721]:   </metadata>
Nov 02 23:18:44 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:18:44 user nova-compute[74721]:     <system>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="serial">ee1c3ce6-0281-46ae-98c3-df163d075533</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="uuid">ee1c3ce6-0281-46ae-98c3-df163d075533</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:18:44 user nova-compute[74721]:     </system>
Nov 02 23:18:44 user nova-compute[74721]:   </sysinfo>
Nov 02 23:18:44 user nova-compute[74721]:   <os>
Nov 02 23:18:44 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:18:44 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:18:44 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:18:44 user nova-compute[74721]:   </os>
Nov 02 23:18:44 user nova-compute[74721]:   <features>
Nov 02 23:18:44 user nova-compute[74721]:     <acpi/>
Nov 02 23:18:44 user nova-compute[74721]:     <apic/>
Nov 02 23:18:44 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:18:44 user nova-compute[74721]:   </features>
Nov 02 23:18:44 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:18:44 user nova-compute[74721]:   </clock>
Nov 02 23:18:44 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:18:44 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:18:44 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:18:44 user nova-compute[74721]:   </cpu>
Nov 02 23:18:44 user nova-compute[74721]:   <devices>
Nov 02 23:18:44 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:18:44 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:18:44 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk"/>
Nov 02 23:18:44 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:     </disk>
Nov 02 23:18:44 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:18:44 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:18:44 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:18:44 user nova-compute[74721]:       <target dev="vdc" bus="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:       <serial>1f8b09d0-a64a-4b35-af35-73fd20986f27</serial>
Nov 02 23:18:44 user nova-compute[74721]:     </disk>
Nov 02 23:18:44 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:18:44 user nova-compute[74721]:       <mac address="fa:16:3e:f9:ef:9f"/>
Nov 02 23:18:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:18:44 user nova-compute[74721]:       <target dev="tapd2bd5cff-87"/>
Nov 02 23:18:44 user nova-compute[74721]:     </interface>
Nov 02 23:18:44 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:18:44 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/console.log" append="off"/>
Nov 02 23:18:44 user nova-compute[74721]:     </serial>
Nov 02 23:18:44 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:18:44 user nova-compute[74721]:     <video>
Nov 02 23:18:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:     </video>
Nov 02 23:18:44 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:18:44 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:18:44 user nova-compute[74721]:     </rng>
Nov 02 23:18:44 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:18:44 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:18:44 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:18:44 user nova-compute[74721]:     </memballoon>
Nov 02 23:18:44 user nova-compute[74721]:   </devices>
Nov 02 23:18:44 user nova-compute[74721]: </domain>
Nov 02 23:18:44 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-688781644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:16:25.771896',shelved_host='user',shelved_image_id='3b1d6c9a-57f5-4ce2-b6ae-b0d60dd12565'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG os_vif [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbae41ec-78ae-5bd7-84a0-ac5f3ae1d401', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2bd5cff-87, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2bd5cff-87, col_values=(('qos', UUID('01dc4d9d-e1c4-4137-a52e-1430fa9f2d86')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2bd5cff-87, col_values=(('external_ids', {'iface-id': 'd2bd5cff-877a-4067-a204-8ab9bf8bf6a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ef:9f', 'vm-uuid': 'ee1c3ce6-0281-46ae-98c3-df163d075533'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: INFO os_vif [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87')
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance network_info: |[{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Start _get_guest_xml network_info=[{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T23:18:36Z,direct_url=<?>,disk_format='qcow2',id=4bd92455-f456-4c45-b677-7630f87d0e7f,min_disk=0,min_ram=0,name='tempest-scenario-img--135229622',owner='7e6216758d9b4e8abdb1840710239900',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T23:18:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '4bd92455-f456-4c45-b677-7630f87d0e7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No VIF found with MAC fa:16:3e:f9:ef:9f, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:18:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:44 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T23:18:36Z,direct_url=<?>,disk_format='qcow2',id=4bd92455-f456-4c45-b677-7630f87d0e7f,min_disk=0,min_ram=0,name='tempest-scenario-img--135229622',owner='7e6216758d9b4e8abdb1840710239900',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T23:18:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607078100',display_name='tempest-TestMinimumBasicScenario-server-607078100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607078100',id=39,image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLzAhBIvoqF8r8cJKXQfqv2C+rEu5UqtPKm+KmRNUud+YUVy8mLTk3tB60AWpKS5SL3ZXiL/ytdd901f1IH6PZnIR+UrT7FeF58SztU4gF8TF3CjXWsjOVTlHtanQo9uA==',key_name='tempest-TestMinimumBasicScenario-1653010718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-b2rihbnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:18:42Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=34ea2247-7f67-4ea0-b6fe-13826047d6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'pci_devices' on Instance uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:18:44 user nova-compute[74721]:   <uuid>34ea2247-7f67-4ea0-b6fe-13826047d6d8</uuid>
Nov 02 23:18:44 user nova-compute[74721]:   <name>instance-00000027</name>
Nov 02 23:18:44 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:18:44 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:18:44 user nova-compute[74721]:   <metadata>
Nov 02 23:18:44 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:18:44 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:name>tempest-TestMinimumBasicScenario-server-607078100</nova:name>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:18:44</nova:creationTime>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:18:44 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:owner>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:user uuid="2dc6f5e5ea0d4089998a6b8bff41c488">tempest-TestMinimumBasicScenario-493864842-project-member</nova:user>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:project uuid="7e6216758d9b4e8abdb1840710239900">tempest-TestMinimumBasicScenario-493864842</nova:project>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:owner>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:root type="image" uuid="4bd92455-f456-4c45-b677-7630f87d0e7f"/>
Nov 02 23:18:44 user nova-compute[74721]:       <nova:ports>
Nov 02 23:18:44 user nova-compute[74721]:         <nova:port uuid="07ba2295-e6c5-48cd-8fcc-0878f0dc3d06">
Nov 02 23:18:44 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 23:18:44 user nova-compute[74721]:         </nova:port>
Nov 02 23:18:44 user nova-compute[74721]:       </nova:ports>
Nov 02 23:18:44 user nova-compute[74721]:     </nova:instance>
Nov 02 23:18:44 user nova-compute[74721]:   </metadata>
Nov 02 23:18:44 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:18:44 user nova-compute[74721]:     <system>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="serial">34ea2247-7f67-4ea0-b6fe-13826047d6d8</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="uuid">34ea2247-7f67-4ea0-b6fe-13826047d6d8</entry>
Nov 02 23:18:44 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:18:44 user nova-compute[74721]:     </system>
Nov 02 23:18:44 user nova-compute[74721]:   </sysinfo>
Nov 02 23:18:44 user nova-compute[74721]:   <os>
Nov 02 23:18:44 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:18:44 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:18:44 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:18:44 user nova-compute[74721]:   </os>
Nov 02 23:18:44 user nova-compute[74721]:   <features>
Nov 02 23:18:44 user nova-compute[74721]:     <acpi/>
Nov 02 23:18:44 user nova-compute[74721]:     <apic/>
Nov 02 23:18:44 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:18:44 user nova-compute[74721]:   </features>
Nov 02 23:18:44 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:18:44 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:18:44 user nova-compute[74721]:   </clock>
Nov 02 23:18:44 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:18:44 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:18:44 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:18:44 user nova-compute[74721]:   </cpu>
Nov 02 23:18:44 user nova-compute[74721]:   <devices>
Nov 02 23:18:44 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:18:44 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:18:44 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk"/>
Nov 02 23:18:44 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:     </disk>
Nov 02 23:18:44 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:18:44 user nova-compute[74721]:       <mac address="fa:16:3e:ab:45:c5"/>
Nov 02 23:18:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:18:44 user nova-compute[74721]:       <target dev="tap07ba2295-e6"/>
Nov 02 23:18:44 user nova-compute[74721]:     </interface>
Nov 02 23:18:44 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:18:44 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/console.log" append="off"/>
Nov 02 23:18:44 user nova-compute[74721]:     </serial>
Nov 02 23:18:44 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:18:44 user nova-compute[74721]:     <video>
Nov 02 23:18:44 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:18:44 user nova-compute[74721]:     </video>
Nov 02 23:18:44 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:18:44 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:18:44 user nova-compute[74721]:     </rng>
Nov 02 23:18:44 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:18:44 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:18:44 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:18:44 user nova-compute[74721]:     </memballoon>
Nov 02 23:18:44 user nova-compute[74721]:   </devices>
Nov 02 23:18:44 user nova-compute[74721]: </domain>
Nov 02 23:18:44 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607078100',display_name='tempest-TestMinimumBasicScenario-server-607078100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607078100',id=39,image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLzAhBIvoqF8r8cJKXQfqv2C+rEu5UqtPKm+KmRNUud+YUVy8mLTk3tB60AWpKS5SL3ZXiL/ytdd901f1IH6PZnIR+UrT7FeF58SztU4gF8TF3CjXWsjOVTlHtanQo9uA==',key_name='tempest-TestMinimumBasicScenario-1653010718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-b2rihbnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:18:42Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=34ea2247-7f67-4ea0-b6fe-13826047d6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG os_vif [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27aff8d0-8626-50f5-9451-c30ed55a58ff', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07ba2295-e6, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07ba2295-e6, col_values=(('qos', UUID('f58c9e65-1bee-4b04-b646-b6f9bcf650fa')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07ba2295-e6, col_values=(('external_ids', {'iface-id': '07ba2295-e6c5-48cd-8fcc-0878f0dc3d06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:45:c5', 'vm-uuid': '34ea2247-7f67-4ea0-b6fe-13826047d6d8'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:44 user nova-compute[74721]: INFO os_vif [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6')
Nov 02 23:18:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No VIF found with MAC fa:16:3e:ab:45:c5, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:45 user nova-compute[74721]: WARNING nova.compute.manager [req-c7a449c5-0bc7-451d-8e21-9fc5d7d3d6d4 req-24fdd620-613a-4b96-8c65-79e8b2483962 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:47 user nova-compute[74721]: WARNING nova.compute.manager [req-b2b8ac6d-c90e-41c7-8495-9c9bfd8f8187 req-f4d7ca8a-055e-464a-aaca-4eb9249bcbc1 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:18:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:48 user nova-compute[74721]: WARNING nova.compute.manager [req-d79bb4c9-5c1a-4af8-b9d5-e2989c5d0a12 req-198deffe-b338-47b1-b757-8b638568851a service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:49 user nova-compute[74721]: WARNING nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state building and task_state spawning.
Nov 02 23:18:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:49 user nova-compute[74721]: WARNING nova.compute.manager [req-4ce07b08-c9f2-478b-8d43-8c16abffc03b req-bddaebbb-c82c-44a4-8edf-1b15fd9712c6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state building and task_state spawning.
Nov 02 23:18:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:18:50 user nova-compute[74721]: WARNING nova.compute.manager [req-cbd1e231-ce5f-4f21-9b1f-67a4fd054b26 req-06478b0f-7457-410c-91d0-1333d57dcffd service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:50 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:18:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance spawned successfully.
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a1f0167c-dae4-4d15-9796-3fb8082457ce tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.175s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:18:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance spawned successfully.
Nov 02 23:18:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:18:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance spawned successfully.
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:18:51 user nova-compute[74721]: INFO nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 02 23:18:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:18:51 user nova-compute[74721]: INFO nova.compute.manager [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Took 11.14 seconds to build instance.
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-61956b56-5321-488e-a595-7b86f82a830f tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.280s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2e3729d8-10d0-4ef4-9c0a-8005c34ecb49 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 38.813s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:18:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:18:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=24.9964599609375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ee1c3ce6-0281-46ae-98c3-df163d075533 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance d043208f-7d0f-4017-8e4b-f3c28de3a88f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:18:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:18:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuUfiMED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:19:04 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:19:04 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:19:04 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3eb5f-07bd-4eb5-9005-8f54f1b75484]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:19:04 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfa9d3-5e44-4543-b192-c7be0a03143e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a] added
Nov 02 23:19:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0e7b7-e873-4a5a-85f4-87ea93254610]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec4187-d3ad-4fde-8428-0cf0cb1e6cd1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuUfiMED {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuUfiMED" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed766db-a663-4cd3-8916-3599a580ef2e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuUfiMED'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51775b4-8b91-4033-a660-f20fc1cad4a5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda0295-3184-4514-a487-aa45eba657ef]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:04 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:04 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2163b9-80b3-4a1c-9072-4797a812f73c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260]
Nov 02 23:19:04 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260] successful.
Nov 02 23:19:04 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9d6b2-c874-47a5-ae9a-82a9e254fc85]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de627a-aac6-442b-aaa7-bebf33db6b8a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:05 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:05 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:05 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:05 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd708c-8b29-4bc0-bb2c-2c4bbfeff0a4]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:19:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuUfiMED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26165313038343235', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165313038343235', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:19:06 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:19:06 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:19:06 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:19:06 user nova-compute[74721]:   <serial>f167204e-9df4-45de-abea-005cc12ae28a</serial>
Nov 02 23:19:06 user nova-compute[74721]: </disk>
Nov 02 23:19:06 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] No VIF found with MAC fa:16:3e:69:8f:35, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:19:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2405269d-661f-472b-9219-421ea8b54b4c tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.890s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:07 user nova-compute[74721]: INFO nova.compute.manager [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Detaching volume f167204e-9df4-45de-abea-005cc12ae28a
Nov 02 23:19:07 user nova-compute[74721]: INFO nova.virt.block_device [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Attempting to driver detach volume f167204e-9df4-45de-abea-005cc12ae28a from mountpoint /dev/vdb
Nov 02 23:19:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Attempting to detach device vdb from instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:19:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:19:07 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:19:07 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:19:07 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:19:07 user nova-compute[74721]:   <serial>f167204e-9df4-45de-abea-005cc12ae28a</serial>
Nov 02 23:19:07 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:19:07 user nova-compute[74721]: </disk>
Nov 02 23:19:07 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:19:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 from the persistent domain config.
Nov 02 23:19:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:19:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:19:07 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:19:07 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:19:07 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:19:07 user nova-compute[74721]:   <serial>f167204e-9df4-45de-abea-005cc12ae28a</serial>
Nov 02 23:19:07 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:19:07 user nova-compute[74721]: </disk>
Nov 02 23:19:07 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:19:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:19:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:19:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAWTfoyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:19:20 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:19:20 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:19:20 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efcb5c-23b3-4317-bf60-42854d401eec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:19:20 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[15622918-b5f8-4692-a35b-104bb27aabce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79] added
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbefbde8-5db2-4b6e-b4fd-08f42a868603]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6260c-d082-4776-a14e-7adf9f0413cd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAWTfoyu {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAWTfoyu" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[377283ed-32ba-41ef-848c-e88772934f62]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dAWTfoyu'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38d841-5c17-42db-8fe9-113fd7d3cc7e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[305503a1-de17-4e61-adb2-252828f8cd49]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[def90085-a517-4320-b973-fde13ca5c002]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260]
Nov 02 23:19:20 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260] successful.
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd7576-d1bd-43ac-8177-93b9646590a2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd347875-3cec-46e6-a17b-ffcebb4285e6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:20 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:19:20 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea40f9-2e54-48c2-a524-98a06ad54afa]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:19:20 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAWTfoyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23236663836343632', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236663836343632', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'flavor' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:19:21 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:19:21 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:19:21 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:19:21 user nova-compute[74721]:   <serial>ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79</serial>
Nov 02 23:19:21 user nova-compute[74721]: </disk>
Nov 02 23:19:21 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:53:23:3a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ccfd2c54-fd05-4fc6-9d21-e6c3b98e79d7 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.750s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:22 user nova-compute[74721]: INFO nova.compute.manager [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Rescuing
Nov 02 23:19:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:19:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:19:23 user nova-compute[74721]: WARNING nova.compute.manager [req-cbd2677b-f6b6-43f0-90d2-660cd0a9afaa req-442eaaa7-7597-4c4f-af81-3348a57676b8 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state active and task_state rescuing.
Nov 02 23:19:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:23 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance destroyed successfully.
Nov 02 23:19:23 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Attempting rescue
Nov 02 23:19:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:19:23 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:19:23 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Creating image(s)
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue" returned: 0 in 0.065s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'migration_context' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.base [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<47459418-703e-46a3-bc42-b7034ee8af46> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start _get_guest_xml network_info=[{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:53:23:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.base [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<47459418-703e-46a3-bc42-b7034ee8af46> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'numa_topology' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.base [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<47459418-703e-46a3-bc42-b7034ee8af46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:19:24 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:19:24 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.base [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<47459418-703e-46a3-bc42-b7034ee8af46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606480863',display_name='tempest-ServerRescueNegativeTestJSON-server-606480863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606480863',id=36,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZtwikCAcxIuESk9O23FU5EtdfS+/vVWL0PgZOOvpbCMg6V/MhBHwLfozhAXcDP2kN8wrz1Fmp/L/hK5ip3bYocAIZA3/ABnG2p6WE9DphcTzLQzAXXdv51+4WNYyFhw==',key_name='tempest-keypair-1005684426',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-vg70b9bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=47459418-703e-46a3-bc42-b7034ee8af46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:53:23:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "vif_mac": "fa:16:3e:53:23:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'pci_devices' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.objects.base [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Object Instance<47459418-703e-46a3-bc42-b7034ee8af46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:19:24 user nova-compute[74721]:   <uuid>47459418-703e-46a3-bc42-b7034ee8af46</uuid>
Nov 02 23:19:24 user nova-compute[74721]:   <name>instance-00000024</name>
Nov 02 23:19:24 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:19:24 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:19:24 user nova-compute[74721]:   <metadata>
Nov 02 23:19:24 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:19:24 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-606480863</nova:name>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:19:24</nova:creationTime>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:19:24 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:19:24 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:owner>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:user uuid="ee89915190bc4dcaafc152b0767d70a1">tempest-ServerRescueNegativeTestJSON-544702659-project-member</nova:user>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:project uuid="4dc5e65b042947ed8f88d0a0722d2f78">tempest-ServerRescueNegativeTestJSON-544702659</nova:project>
Nov 02 23:19:24 user nova-compute[74721]:       </nova:owner>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:19:24 user nova-compute[74721]:       <nova:ports>
Nov 02 23:19:24 user nova-compute[74721]:         <nova:port uuid="402d30fc-6fb0-4996-965d-8cc06efb456f">
Nov 02 23:19:24 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 23:19:24 user nova-compute[74721]:         </nova:port>
Nov 02 23:19:24 user nova-compute[74721]:       </nova:ports>
Nov 02 23:19:24 user nova-compute[74721]:     </nova:instance>
Nov 02 23:19:24 user nova-compute[74721]:   </metadata>
Nov 02 23:19:24 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:19:24 user nova-compute[74721]:     <system>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="serial">47459418-703e-46a3-bc42-b7034ee8af46</entry>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="uuid">47459418-703e-46a3-bc42-b7034ee8af46</entry>
Nov 02 23:19:24 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:19:24 user nova-compute[74721]:     </system>
Nov 02 23:19:24 user nova-compute[74721]:   </sysinfo>
Nov 02 23:19:24 user nova-compute[74721]:   <os>
Nov 02 23:19:24 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:19:24 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:19:24 user nova-compute[74721]:   </os>
Nov 02 23:19:24 user nova-compute[74721]:   <features>
Nov 02 23:19:24 user nova-compute[74721]:     <acpi/>
Nov 02 23:19:24 user nova-compute[74721]:     <apic/>
Nov 02 23:19:24 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:19:24 user nova-compute[74721]:   </features>
Nov 02 23:19:24 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:19:24 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:19:24 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:19:24 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:19:24 user nova-compute[74721]:   </clock>
Nov 02 23:19:24 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:19:24 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:19:24 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:19:24 user nova-compute[74721]:   </cpu>
Nov 02 23:19:24 user nova-compute[74721]:   <devices>
Nov 02 23:19:24 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:19:24 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:19:24 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue"/>
Nov 02 23:19:24 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:19:24 user nova-compute[74721]:     </disk>
Nov 02 23:19:24 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:19:24 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:19:24 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk"/>
Nov 02 23:19:24 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:19:24 user nova-compute[74721]:     </disk>
Nov 02 23:19:24 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:19:24 user nova-compute[74721]:       <mac address="fa:16:3e:53:23:3a"/>
Nov 02 23:19:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:19:24 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:19:24 user nova-compute[74721]:       <target dev="tap402d30fc-6f"/>
Nov 02 23:19:24 user nova-compute[74721]:     </interface>
Nov 02 23:19:24 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:19:24 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/console.log" append="off"/>
Nov 02 23:19:24 user nova-compute[74721]:     </serial>
Nov 02 23:19:24 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:19:24 user nova-compute[74721]:     <video>
Nov 02 23:19:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:19:24 user nova-compute[74721]:     </video>
Nov 02 23:19:24 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:19:24 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:19:24 user nova-compute[74721]:     </rng>
Nov 02 23:19:24 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:19:24 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:19:24 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:19:24 user nova-compute[74721]:     </memballoon>
Nov 02 23:19:24 user nova-compute[74721]:   </devices>
Nov 02 23:19:24 user nova-compute[74721]: </domain>
Nov 02 23:19:24 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:19:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance destroyed successfully.
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] No VIF found with MAC fa:16:3e:53:23:3a, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:19:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:19:25 user nova-compute[74721]: WARNING nova.compute.manager [req-a2e1af34-9d7b-41e2-b58c-81296b18ef2f req-b870998b-9d7d-4dd1-8d3b-f0569488dfba service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state active and task_state rescuing.
Nov 02 23:19:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:19:27 user nova-compute[74721]: WARNING nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state active and task_state rescuing.
Nov 02 23:19:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:19:27 user nova-compute[74721]: WARNING nova.compute.manager [req-ae8d505e-a458-4630-8c99-9b1fe55e655a req-24e656a4-2ab8-48c5-8947-44834337900d service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state active and task_state rescuing.
Nov 02 23:19:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 is timed out.
Nov 02 23:19:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully detached device vdb from instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 from the live domain config.
Nov 02 23:19:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuUfiMED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:19:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f13dde-fac1-411b-8ada-71092e6941b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:19:27 user nova-compute[74721]: No targets found.
Nov 02 23:19:27 user nova-compute[74721]: iSNS:
Nov 02 23:19:27 user nova-compute[74721]: No targets found.
Nov 02 23:19:27 user nova-compute[74721]: STATIC:
Nov 02 23:19:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0
Nov 02 23:19:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:19:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:19:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27
Nov 02 23:19:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:19:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:19:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a
Nov 02 23:19:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:19:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:19:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:19:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:19:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:19:27 user nova-compute[74721]: FIRMWARE:
Nov 02 23:19:27 user nova-compute[74721]: No targets found.
Nov 02 23:19:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:19:27 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:19:27 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e5aa0-5fb9-4b57-80c4-ca5b0fa6cd67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139d885-af87-4ac8-86d5-e8601d5d9b32]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a (non-flash)
Nov 02 23:19:28 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:19:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c3a8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80b9fb6-e0a7-4660-9bfb-0201dc825250]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e457c18-02bf-4b45-a6e0-241125369a86]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0043675c-abc2-4b1c-9eb6-cd2c73431677]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7d963-6225-4bb7-ac74-48c43cc708e6]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd58e0e3-a171-4bfc-b1a4-f217f8453fe3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f741ab-01c9-412b-a1ec-49dd34693c7f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260]
Nov 02 23:19:28 user nova-compute[74721]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a, portal: 172.16.0.220,3260] successful.
Nov 02 23:19:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f167204e-9df4-45de-abea-005cc12ae28a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd73923-e233-4f2e-a248-8888ed80dca1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] <== disconnect_volume: return (356ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:19:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-2132f3f7-90aa-4a8c-a84f-f6b383d2f03c tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:19:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'flavor' on Instance uuid 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-29d76f9a-f0ef-48b6-8dd1-055d760aa58d tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.169s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:19:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:19:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [{"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ad44e9ee-70f5-4a28-b05d-b2de910419e2" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:19:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:19:46 user nova-compute[74721]: INFO nova.compute.claims [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Claim successful on node user
Nov 02 23:19:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:19:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:46 user nova-compute[74721]: DEBUG nova.policy [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b54b65445a47929910242fa7206851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0a955207b54b909bf41ecfc6198291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:19:46 user nova-compute[74721]: INFO nova.virt.block_device [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Booting with blank volume at /dev/vda
Nov 02 23:19:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Successfully created port: 73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:19:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Successfully updated port: 73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-changed-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Refreshing instance network info cache due to event network-changed-73a2c67c-8320-4a37-8512-cdcfcfcaf992. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance network_info: |[{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:19:48 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Refreshing network info cache for port 73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:19:49 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Updated VIF entry in instance network info cache for port 73a2c67c-8320-4a37-8512-cdcfcfcaf992. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:19:49 user nova-compute[74721]: DEBUG nova.network.neutron [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:19:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7c6b1b2c-e4ac-431f-970b-46b3a2693efa req-cfc47986-0287-489d-bd3f-e67a0ca13c3a service nova] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:19:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.utils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee3df58-02ac-4477-a8be-91e8544cbe0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5623c91f-0bfd-416f-bd84-38aa74ccf983]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a09cd3d-6d04-4b7e-aa3d-98f7d53748d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6075c64-f470-40f6-8e7f-853ab6a92111]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:19:52 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a74a5-c2da-4242-993a-522349776e72]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG os_brick.utils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating existing volume attachment record: 162a6a19-26b7-4ae7-8dd7-54d36b8f9bc9 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:19:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:19:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:19:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.053359985351562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 7f62294b-7c3c-4461-aa87-d70b65ae1528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ee1c3ce6-0281-46ae-98c3-df163d075533 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance d043208f-7d0f-4017-8e4b-f3c28de3a88f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:57 user nova-compute[74721]: INFO nova.compute.manager [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Terminating instance
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-unplugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] No waiting events found dispatching network-vif-unplugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:19:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-0e694536-5898-44c4-9953-98dceb3f518b req-796364dc-cdef-4d27-8a57-09a589da84cd service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-unplugged-bca8d68e-726f-40ff-af27-4af38ace54aa for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:19:58 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Instance destroyed successfully.
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lazy-loading 'resources' on Instance uuid 7f62294b-7c3c-4461-aa87-d70b65ae1528 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098837632',display_name='tempest-AttachVolumeNegativeTest-server-2098837632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098837632',id=37,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcB6fqfNXCtVZYIyMeW7Wk1e8MMn3Gfh3VU7Fks8l57mpKE6mlSwwCXox3aEwJhp933gqAm2W7g+OPVKLj2O3bIZ4qyShUxTwQE5QlgnRh2hU4fAvlBZyUqcYTsE9v1Tg==',key_name='tempest-keypair-384855023',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bd99aa517e74a5aa15c46d174a025b0',ramdisk_id='',reservation_id='r-m8dk4hj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1503140472',owner_user_name='tempest-AttachVolumeNegativeTest-1503140472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83010d67d3514cd69c99767c0b77fb67',uuid=7f62294b-7c3c-4461-aa87-d70b65ae1528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converting VIF {"id": "bca8d68e-726f-40ff-af27-4af38ace54aa", "address": "fa:16:3e:69:8f:35", "network": {"id": "b13421eb-db09-4a6d-8294-107d688b7715", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-293492908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bd99aa517e74a5aa15c46d174a025b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca8d68e-72", "ovs_interfaceid": "bca8d68e-726f-40ff-af27-4af38ace54aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG os_vif [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbca8d68e-72, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b61a783e-2394-475d-9460-ca89abbd39d0) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:19:58 user nova-compute[74721]: INFO os_vif [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:8f:35,bridge_name='br-int',has_traffic_filtering=True,id=bca8d68e-726f-40ff-af27-4af38ace54aa,network=Network(b13421eb-db09-4a6d-8294-107d688b7715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca8d68e-72')
Nov 02 23:19:58 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Deleting instance files /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528_del
Nov 02 23:19:58 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Deletion of /opt/stack/data/nova/instances/7f62294b-7c3c-4461-aa87-d70b65ae1528_del complete
Nov 02 23:19:58 user nova-compute[74721]: INFO nova.compute.manager [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 02 23:19:58 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:19:58 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:19:59 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Took 0.91 seconds to deallocate network for instance.
Nov 02 23:19:59 user nova-compute[74721]: DEBUG nova.compute.manager [req-4994936a-9b3a-4be6-be18-2ce9b9169fc1 req-3b15f2c7-392c-4ed9-84a1-a71523b5ee11 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-deleted-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:19:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:19:59 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Deleted allocations for instance 7f62294b-7c3c-4461-aa87-d70b65ae1528
Nov 02 23:20:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] Acquiring lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] No waiting events found dispatching network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:00 user nova-compute[74721]: WARNING nova.compute.manager [req-b0046156-ba66-488a-8d02-3e5ac94824eb req-09e0cc9b-9f0a-4786-bbaa-8ec899d06539 service nova] [instance: 7f62294b-7c3c-4461-aa87-d70b65ae1528] Received unexpected event network-vif-plugged-bca8d68e-726f-40ff-af27-4af38ace54aa for instance with vm_state deleted and task_state None.
Nov 02 23:20:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a8b5bd62-0c53-4316-b690-f16a44fec4a4 tempest-AttachVolumeNegativeTest-1503140472 tempest-AttachVolumeNegativeTest-1503140472-project-member] Lock "7f62294b-7c3c-4461-aa87-d70b65ae1528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:03 user nova-compute[74721]: INFO nova.compute.manager [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Detaching volume 1f8b09d0-a64a-4b35-af35-73fd20986f27
Nov 02 23:20:03 user nova-compute[74721]: INFO nova.virt.block_device [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Attempting to driver detach volume 1f8b09d0-a64a-4b35-af35-73fd20986f27 from mountpoint /dev/vdc
Nov 02 23:20:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Attempting to detach device vdc from instance ee1c3ce6-0281-46ae-98c3-df163d075533 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:20:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:20:03 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:20:03 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:20:03 user nova-compute[74721]:   <target dev="vdc" bus="virtio"/>
Nov 02 23:20:03 user nova-compute[74721]:   <serial>1f8b09d0-a64a-4b35-af35-73fd20986f27</serial>
Nov 02 23:20:03 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:20:03 user nova-compute[74721]: </disk>
Nov 02 23:20:03 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:20:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully detached device vdc from instance ee1c3ce6-0281-46ae-98c3-df163d075533 from the persistent domain config.
Nov 02 23:20:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ee1c3ce6-0281-46ae-98c3-df163d075533 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:20:03 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:20:03 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:20:03 user nova-compute[74721]:   <source dev="/dev/sdc"/>
Nov 02 23:20:03 user nova-compute[74721]:   <target dev="vdc" bus="virtio"/>
Nov 02 23:20:03 user nova-compute[74721]:   <serial>1f8b09d0-a64a-4b35-af35-73fd20986f27</serial>
Nov 02 23:20:03 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 23:20:03 user nova-compute[74721]: </disk>
Nov 02 23:20:03 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:20:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:20:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing instance network info cache due to event network-changed-894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] Acquiring lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] Acquired lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Refreshing network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:07 user nova-compute[74721]: INFO nova.compute.manager [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Terminating instance
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updated VIF entry in instance network info cache for port 894be900-e9b5-4bab-85e3-e97ea45970fc. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [{"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-613edce4-84e8-4022-838f-73f108f54263 req-47bf0594-c04f-439f-b77f-2f4ac45a06fc service nova] Releasing lock "refresh_cache-d043208f-7d0f-4017-8e4b-f3c28de3a88f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:20:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Instance destroyed successfully.
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lazy-loading 'resources' on Instance uuid d043208f-7d0f-4017-8e4b-f3c28de3a88f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1774225187',display_name='tempest-TestShelveInstance-server-1774225187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1774225187',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAorZAvtfoyq4SLBBhxgQTiRIpi4CiKVQ3l47MYLHjlcsX1NskJ3y83XVLZsv4N3bTeX02GlgvwIukXvVwRfLACDm4SVXDoPA2kQzdzMOwfk9UtaXvCCfag9CbY+dxKqhQ==',key_name='tempest-TestShelveInstance-1797066865',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a24963e0da47008a77678475eae00c',ramdisk_id='',reservation_id='r-qyszk0v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1226338228',owner_user_name='tempest-TestShelveInstance-1226338228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:18:51Z,user_data=None,user_id='ace8a1614dbb40f1abbcec0433775de1',uuid=d043208f-7d0f-4017-8e4b-f3c28de3a88f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converting VIF {"id": "894be900-e9b5-4bab-85e3-e97ea45970fc", "address": "fa:16:3e:2e:d9:13", "network": {"id": "ca964f8a-6e72-49f9-935b-dae59665dc9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-456735393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a24963e0da47008a77678475eae00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894be900-e9", "ovs_interfaceid": "894be900-e9b5-4bab-85e3-e97ea45970fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_vif [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap894be900-e9, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecfbea5b-5500-43cc-a64b-49ef37873603) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:07 user nova-compute[74721]: INFO os_vif [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:13,bridge_name='br-int',has_traffic_filtering=True,id=894be900-e9b5-4bab-85e3-e97ea45970fc,network=Network(ca964f8a-6e72-49f9-935b-dae59665dc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894be900-e9')
Nov 02 23:20:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlaGkTVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:07 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d80737-aefb-47d2-a27d-3db65419c1ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:20:07 user nova-compute[74721]: No targets found.
Nov 02 23:20:07 user nova-compute[74721]: iSNS:
Nov 02 23:20:07 user nova-compute[74721]: No targets found.
Nov 02 23:20:07 user nova-compute[74721]: STATIC:
Nov 02 23:20:07 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0
Nov 02 23:20:07 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:20:07 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:20:07 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27
Nov 02 23:20:07 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:20:07 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:20:07 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:20:07 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:20:07 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:20:07 user nova-compute[74721]: FIRMWARE:
Nov 02 23:20:07 user nova-compute[74721]: No targets found.
Nov 02 23:20:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:20:07 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:20:07 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d107b7-0ad4-4c25-b3ba-bf8adbdbb2b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d77f9a-d285-4a65-81e0-e13bc80d1503]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:07 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf47c84940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd951f4-29bc-4d9a-807b-218179798910]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa39aab-6739-4d8c-9340-fcd4bb5c0262]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc30ed-e762-4d15-ad62-acfad8445bb9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ae7569-c3d0-4480-97a9-c46b3246b73d]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23865663539393862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d28e3958', '/dev/disk/by-id/scsi-1SCST_BIOd28e3958-8ef5998b4f39542a') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:20:08 user nova-compute[74721]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23865663539393862
Nov 02 23:20:08 user nova-compute[74721]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d28e3958
Nov 02 23:20:08 user nova-compute[74721]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd28e3958-8ef5998b4f39542a
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de69344d-f043-4d4a-b9f0-e7a7bb073dce]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f18610-18d3-4cb0-ac0e-bb21a7df2a2f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38339fb7-1e87-4ee5-affc-e92896678b0f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260]
Nov 02 23:20:08 user nova-compute[74721]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0, portal: 172.16.0.220,3260] successful.
Nov 02 23:20:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbdff50-f861-4bf2-a69a-7366d21b51a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ec4ec-5cfe-4183-978d-7a4bf7548b0f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] <== disconnect_volume: return (357ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:20:08 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deleting instance files /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f_del
Nov 02 23:20:08 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deletion of /opt/stack/data/nova/instances/d043208f-7d0f-4017-8e4b-f3c28de3a88f_del complete
Nov 02 23:20:08 user nova-compute[74721]: INFO nova.compute.manager [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 23:20:08 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-46718a39-6aa4-441c-91c3-826fd421977f req-a4b7d14a-e73a-46ad-931d-939d8492f0a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-deleted-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:08 user nova-compute[74721]: INFO nova.compute.manager [req-46718a39-6aa4-441c-91c3-826fd421977f req-a4b7d14a-e73a-46ad-931d-939d8492f0a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Neutron deleted interface 894be900-e9b5-4bab-85e3-e97ea45970fc; detaching it from the instance and deleting it from the info cache
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-46718a39-6aa4-441c-91c3-826fd421977f req-a4b7d14a-e73a-46ad-931d-939d8492f0a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:08 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Took 0.46 seconds to deallocate network for instance.
Nov 02 23:20:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-46718a39-6aa4-441c-91c3-826fd421977f req-a4b7d14a-e73a-46ad-931d-939d8492f0a7 service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Detach interface failed, port_id=894be900-e9b5-4bab-85e3-e97ea45970fc, reason: Instance d043208f-7d0f-4017-8e4b-f3c28de3a88f could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-unplugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Acquiring lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:09 user nova-compute[74721]: DEBUG nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] No waiting events found dispatching network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:09 user nova-compute[74721]: WARNING nova.compute.manager [req-98bd7607-cb0a-47b3-a143-42cbf7e1c5f7 req-24b00f37-5d1b-4397-9a94-c785590413ce service nova] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Received unexpected event network-vif-plugged-894be900-e9b5-4bab-85e3-e97ea45970fc for instance with vm_state active and task_state deleting.
Nov 02 23:20:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:20:15 user nova-compute[74721]: INFO nova.compute.claims [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Claim successful on node user
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:20:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.policy [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:20:15 user nova-compute[74721]: INFO nova.virt.block_device [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Booting with volume 10196e6e-d89b-49a5-84f5-4a73e97301b3 at /dev/vda
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.utils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338636f-86d6-4963-a6e5-e152a6a53259]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dcb58f-1cc7-4c4e-bd78-bf440db38d32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f6de5-faf3-43e8-9af7-f0480deb54fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e1c11-e75d-4b70-8f67-6696cc247f78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:20:15 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:20:15 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[065e86d4-9d76-4673-897f-34c0f66ff75d]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG os_brick.utils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:15 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updating existing volume attachment record: b8582ae9-90d3-4190-b57d-af1f1fc5c035 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:20:16 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Successfully created port: 48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:20:16 user nova-compute[74721]: INFO nova.compute.manager [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Took 7.91 seconds to detach 1 volumes for instance.
Nov 02 23:20:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] [instance: d043208f-7d0f-4017-8e4b-f3c28de3a88f] Deleting volume: ecbdff50-f861-4bf2-a69a-7366d21b51a0 {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:20:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Successfully updated port: 48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-changed-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Refreshing instance network info cache due to event network-changed-48aa02d5-0025-4eb0-82e0-b7660e4ffd11. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] Acquiring lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:17 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Deleted allocations for instance d043208f-7d0f-4017-8e4b-f3c28de3a88f
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-acb7a3a1-f356-440b-98cd-ad392be49812 tempest-TestShelveInstance-1226338228 tempest-TestShelveInstance-1226338228-project-member] Lock "d043208f-7d0f-4017-8e4b-f3c28de3a88f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.251s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updating instance_info_cache with network_info: [{"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Instance network_info: |[{"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] Acquired lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Refreshing network info cache for port 48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updated VIF entry in instance network info cache for port 48aa02d5-0025-4eb0-82e0-b7660e4ffd11. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updating instance_info_cache with network_info: [{"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6df5f8e9-6d0f-4d91-9781-9c2d9e3ae9de req-150cae77-02ed-4708-93d7-84178a40b28b service nova] Releasing lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:20:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:24 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ee1c3ce6-0281-46ae-98c3-df163d075533 is timed out.
Nov 02 23:20:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully detached device vdc from instance ee1c3ce6-0281-46ae-98c3-df163d075533 from the live domain config.
Nov 02 23:20:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeXwjhq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:24 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef9692-b587-4734-b626-dffd93787c07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:20:24 user nova-compute[74721]: No targets found.
Nov 02 23:20:24 user nova-compute[74721]: iSNS:
Nov 02 23:20:24 user nova-compute[74721]: No targets found.
Nov 02 23:20:24 user nova-compute[74721]: STATIC:
Nov 02 23:20:24 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27
Nov 02 23:20:24 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:20:24 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:20:24 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:20:24 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:20:24 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:20:24 user nova-compute[74721]: FIRMWARE:
Nov 02 23:20:24 user nova-compute[74721]: No targets found.
Nov 02 23:20:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:20:24 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:20:24 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafecf5d-2e53-4e3a-8111-ecbf8381ce55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8cd53-f9e3-49ee-b7ac-5936e6b67cdd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:20:24 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 (non-flash)
Nov 02 23:20:24 user nova-compute[74721]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24173250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[580034d9-f40e-4c02-a946-78f30754efb1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6049bf-28a6-4c97-a4ae-30bca367d6c9]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09c6c4-aabc-4282-be03-b72e1dbd3fa4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a628a8-faea-4507-9d04-9ecb4990a779]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5d977-eb05-40c2-a103-c8a0f3365e34]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475628c-fcae-4daa-bdae-15e887177a78]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260]
Nov 02 23:20:24 user nova-compute[74721]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27, portal: 172.16.0.220,3260] successful.
Nov 02 23:20:24 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8b09d0-a64a-4b35-af35-73fd20986f27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbee593-c30c-483b-b060-8195090fc078]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] <== disconnect_volume: return (307ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:20:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'flavor' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a443ff9b-d63f-425d-8bb7-046b778d2127 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.153s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:20:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Creating image(s)
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Ensure instance console log exists: /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start _get_guest_xml network_info=[{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '162a6a19-26b7-4ae7-8dd7-54d36b8f9bc9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b120c949-845c-47ad-a10b-602434960dae', 'attached_at': '', 'detached_at': '', 'volume_id': '066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'serial': '066831a7-b79c-4fdd-86c1-16a0a4cceb39'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:20:29 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:29 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:29 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:29 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:29 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0e08be-e40c-4407-862e-2fcfec028b1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:20:29 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d6619-0149-4492-8ae7-12486f83b652]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39] added
Nov 02 23:20:29 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c049e-418a-4148-a9a5-dedeab3a7e1d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:29 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a35891-202c-4ec8-a758-734f0f4c9e6e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgdtDLEn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgdtDLEn" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7538c582-ba4e-4d93-9f2b-e0526f22607e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgdtDLEn'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3384a02-3d24-47bd-acf2-1c2d8663d95f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed8fb4-bd7b-4638-9089-83f76608b338]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a98d1-8a97-4fda-8b79-0ea962b93ee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260]
Nov 02 23:20:30 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260] successful.
Nov 02 23:20:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65fe6c2-f8d7-4e90-93c2-18e0e73b64e4]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5330d698-5d43-4996-9c00-b3e384388914]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:30 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a88732-07b0-4a1d-b408-d405b409cb45]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:30 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26565393536376131', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565393536376131', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179948648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179948648',id=40,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-0zhn1xs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:19:47Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=b120c949-845c-47ad-a10b-602434960dae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.objects.instance [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:20:31 user nova-compute[74721]:   <uuid>b120c949-845c-47ad-a10b-602434960dae</uuid>
Nov 02 23:20:31 user nova-compute[74721]:   <name>instance-00000028</name>
Nov 02 23:20:31 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:20:31 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:20:31 user nova-compute[74721]:   <metadata>
Nov 02 23:20:31 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:20:31 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-179948648</nova:name>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:20:29</nova:creationTime>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:20:31 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:20:31 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:owner>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:20:31 user nova-compute[74721]:       </nova:owner>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:20:31 user nova-compute[74721]:       <nova:ports>
Nov 02 23:20:31 user nova-compute[74721]:         <nova:port uuid="73a2c67c-8320-4a37-8512-cdcfcfcaf992">
Nov 02 23:20:31 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 23:20:31 user nova-compute[74721]:         </nova:port>
Nov 02 23:20:31 user nova-compute[74721]:       </nova:ports>
Nov 02 23:20:31 user nova-compute[74721]:     </nova:instance>
Nov 02 23:20:31 user nova-compute[74721]:   </metadata>
Nov 02 23:20:31 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:20:31 user nova-compute[74721]:     <system>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="serial">b120c949-845c-47ad-a10b-602434960dae</entry>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="uuid">b120c949-845c-47ad-a10b-602434960dae</entry>
Nov 02 23:20:31 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:20:31 user nova-compute[74721]:     </system>
Nov 02 23:20:31 user nova-compute[74721]:   </sysinfo>
Nov 02 23:20:31 user nova-compute[74721]:   <os>
Nov 02 23:20:31 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:20:31 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:20:31 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:20:31 user nova-compute[74721]:   </os>
Nov 02 23:20:31 user nova-compute[74721]:   <features>
Nov 02 23:20:31 user nova-compute[74721]:     <acpi/>
Nov 02 23:20:31 user nova-compute[74721]:     <apic/>
Nov 02 23:20:31 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:20:31 user nova-compute[74721]:   </features>
Nov 02 23:20:31 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:20:31 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:20:31 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:20:31 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:20:31 user nova-compute[74721]:   </clock>
Nov 02 23:20:31 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:20:31 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:20:31 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:20:31 user nova-compute[74721]:   </cpu>
Nov 02 23:20:31 user nova-compute[74721]:   <devices>
Nov 02 23:20:31 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:20:31 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:20:31 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:20:31 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:20:31 user nova-compute[74721]:       <serial>066831a7-b79c-4fdd-86c1-16a0a4cceb39</serial>
Nov 02 23:20:31 user nova-compute[74721]:     </disk>
Nov 02 23:20:31 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:20:31 user nova-compute[74721]:       <mac address="fa:16:3e:07:cc:c9"/>
Nov 02 23:20:31 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:20:31 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:20:31 user nova-compute[74721]:       <target dev="tap73a2c67c-83"/>
Nov 02 23:20:31 user nova-compute[74721]:     </interface>
Nov 02 23:20:31 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:20:31 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/console.log" append="off"/>
Nov 02 23:20:31 user nova-compute[74721]:     </serial>
Nov 02 23:20:31 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:20:31 user nova-compute[74721]:     <video>
Nov 02 23:20:31 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:20:31 user nova-compute[74721]:     </video>
Nov 02 23:20:31 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:20:31 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:20:31 user nova-compute[74721]:     </rng>
Nov 02 23:20:31 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:20:31 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:20:31 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:20:31 user nova-compute[74721]:     </memballoon>
Nov 02 23:20:31 user nova-compute[74721]:   </devices>
Nov 02 23:20:31 user nova-compute[74721]: </domain>
Nov 02 23:20:31 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179948648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179948648',id=40,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-0zhn1xs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:19:47Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=b120c949-845c-47ad-a10b-602434960dae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG os_vif [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78ed95b2-bcc4-51d7-8333-173941930395', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73a2c67c-83, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73a2c67c-83, col_values=(('qos', UUID('a62cf995-4282-4fff-ac73-431328596421')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73a2c67c-83, col_values=(('external_ids', {'iface-id': '73a2c67c-8320-4a37-8512-cdcfcfcaf992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:cc:c9', 'vm-uuid': 'b120c949-845c-47ad-a10b-602434960dae'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:31 user nova-compute[74721]: INFO os_vif [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83')
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:20:31 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:07:cc:c9, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:32 user nova-compute[74721]: WARNING nova.compute.manager [req-749916cc-8ac9-4f8b-a77b-35b7b73286eb req-bea8bd6c-d2ef-45c4-81d2-93af87ed18a6 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state building and task_state spawning.
Nov 02 23:20:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.compute.manager [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Terminating instance
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Instance destroyed successfully.
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lazy-loading 'resources' on Instance uuid ad44e9ee-70f5-4a28-b05d-b2de910419e2 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079536467',display_name='tempest-SnapshotDataIntegrityTests-server-2079536467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079536467',id=28,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeeXeTA3EVzKdnun45EihBhROiZLVfkQ/M2BakGTj1R9YLBqWjB7Lm+36SJf3KYmnv5Ebc+zx/kY3Y8+YKNAmr+F4IB+OvQnmHIEJFoAajGYtSrvvEAn3d0TL801di46g==',key_name='tempest-keypair-236405300',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:09:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77852adbb3ec456d857643fc25923ade',ramdisk_id='',reservation_id='r-wgzxdrqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1233588154',owner_user_name='tempest-SnapshotDataIntegrityTests-1233588154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa1c7ca10f41098e7638458b5b0cfc',uuid=ad44e9ee-70f5-4a28-b05d-b2de910419e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converting VIF {"id": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "address": "fa:16:3e:ac:49:ba", "network": {"id": "41fa2cd7-a1f1-43f7-ace4-64c40aec92a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1271574958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77852adbb3ec456d857643fc25923ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f79c3b-70", "ovs_interfaceid": "40f79c3b-70d5-4319-a9de-8f49f58f4945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG os_vif [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40f79c3b-70, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20d9a68c-da20-4134-bef4-e159c1d554c3) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:34 user nova-compute[74721]: INFO os_vif [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:49:ba,bridge_name='br-int',has_traffic_filtering=True,id=40f79c3b-70d5-4319-a9de-8f49f58f4945,network=Network(41fa2cd7-a1f1-43f7-ace4-64c40aec92a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f79c3b-70')
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Deleting instance files /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2_del
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Deletion of /opt/stack/data/nova/instances/ad44e9ee-70f5-4a28-b05d-b2de910419e2_del complete
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance spawned successfully.
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:34 user nova-compute[74721]: WARNING nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state building and task_state spawning.
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-unplugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] No waiting events found dispatching network-vif-unplugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-unplugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Acquiring lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] No waiting events found dispatching network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:34 user nova-compute[74721]: WARNING nova.compute.manager [req-f87e8502-b2d4-4db8-8fa0-f84412132155 req-6888ebca-3215-441c-9ffc-091a0244b8b7 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received unexpected event network-vif-plugged-40f79c3b-70d5-4319-a9de-8f49f58f4945 for instance with vm_state active and task_state deleting.
Nov 02 23:20:34 user nova-compute[74721]: INFO nova.compute.manager [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 02 23:20:34 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:20:34 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:20:35 user nova-compute[74721]: INFO nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 02 23:20:35 user nova-compute[74721]: DEBUG nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:20:35 user nova-compute[74721]: INFO nova.compute.manager [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Took 48.84 seconds to build instance.
Nov 02 23:20:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-749d1c00-d137-47dd-b049-213c18ffb53b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.932s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:35 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:35 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Took 0.81 seconds to deallocate network for instance.
Nov 02 23:20:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-b648e5ba-2b35-4b37-b164-4843552bf3ab req-19213a79-eea8-49e2-af35-76e7874c4297 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Received event network-vif-deleted-40f79c3b-70d5-4319-a9de-8f49f58f4945 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:35 user nova-compute[74721]: INFO nova.compute.manager [req-b648e5ba-2b35-4b37-b164-4843552bf3ab req-19213a79-eea8-49e2-af35-76e7874c4297 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Neutron deleted interface 40f79c3b-70d5-4319-a9de-8f49f58f4945; detaching it from the instance and deleting it from the info cache
Nov 02 23:20:35 user nova-compute[74721]: DEBUG nova.network.neutron [req-b648e5ba-2b35-4b37-b164-4843552bf3ab req-19213a79-eea8-49e2-af35-76e7874c4297 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-b648e5ba-2b35-4b37-b164-4843552bf3ab req-19213a79-eea8-49e2-af35-76e7874c4297 service nova] [instance: ad44e9ee-70f5-4a28-b05d-b2de910419e2] Detach interface failed, port_id=40f79c3b-70d5-4319-a9de-8f49f58f4945, reason: Instance ad44e9ee-70f5-4a28-b05d-b2de910419e2 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:20:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:36 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:20:36 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:20:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:36 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Deleted allocations for instance ad44e9ee-70f5-4a28-b05d-b2de910419e2
Nov 02 23:20:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b919bbde-4d7e-4bb5-b998-1ad5d07a8c69 tempest-SnapshotDataIntegrityTests-1233588154 tempest-SnapshotDataIntegrityTests-1233588154-project-member] Lock "ad44e9ee-70f5-4a28-b05d-b2de910419e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG nova.objects.instance [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:37 user nova-compute[74721]: INFO nova.compute.manager [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Attaching volume 96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 to /dev/vdb
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.utils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8488d24-c317-4c4c-8ef3-aa9254464a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e3f4e-1c0a-4c6e-ba37-9a363849684c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78436431-c437-487c-bd70-703b395dcaf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[916186f7-0f20-4e9a-8e60-692d9171ba3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:20:37 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:20:37 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a841241-eaef-4956-af97-b1532c6d3274]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG os_brick.utils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:37 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating existing volume attachment record: e2b8e7b7-a186-4f0b-aa69-e75dd3091371 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:20:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:43 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:43 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:20:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:20:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:20:43 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:20:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:20:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Creating image(s)
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Ensure instance console log exists: /opt/stack/data/nova/instances/1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Start _get_guest_xml network_info=[{"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'b8582ae9-90d3-4190-b57d-af1f1fc5c035', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwaCTBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5', 'attached_at': '', 'detached_at': '', 'volume_id': '10196e6e-d89b-49a5-84f5-4a73e97301b3', 'serial': '10196e6e-d89b-49a5-84f5-4a73e97301b3'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:20:47 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:47 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwaCTBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:47 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:47 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848ee37-1232-425a-9504-337f55d58da2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:20:47 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be2723-7529-4f99-a470-02d43ef9753a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3] added
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2bb4b-4aea-4593-b498-070178a89b09]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2e4484-a913-401a-9a16-3b8a360a8dab]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwaCTBhp {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwaCTBhp" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77b21f-9de6-4ef7-b790-ea2c98aaad36]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwaCTBhp'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd5fd48-cb86-4cd0-ac64-c8b4890ae49c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd98574f-3a95-4e1d-b5d1-3bc31f40dc42]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8dee6b-4877-4842-9d89-c29f5873ff9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260]
Nov 02 23:20:47 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260] successful.
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2436e5-3eef-41b7-8a90-ba0ef8bdc6dc]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a16728-9e33-43be-af98-1536014e71c5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:47 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ebcb4-62de-4150-9bbb-510006d7a076]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwaCTBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:20:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23630643265613734', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630643265613734', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1859595536',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5JgMri7zoT37QPEZ9Ep5w7T4eXAgf5aRXJlKMmP+vEDQqPwiPKazue0iwQz8scmNcuMrFUidvuJAObE7noDfD9HlmBUwA89RLelJiLiF2sPScrWPMuJqGT+cXGQM/m9Q==',key_name='tempest-keypair-749712009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pn3gwn0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.objects.instance [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:20:48 user nova-compute[74721]:   <uuid>1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5</uuid>
Nov 02 23:20:48 user nova-compute[74721]:   <name>instance-00000029</name>
Nov 02 23:20:48 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:20:48 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:20:48 user nova-compute[74721]:   <metadata>
Nov 02 23:20:48 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:20:48 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:20:48 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1859595536</nova:name>
Nov 02 23:20:48 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:20:47</nova:creationTime>
Nov 02 23:20:48 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:20:48 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:20:48 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:20:48 user nova-compute[74721]:       <nova:owner>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:20:48 user nova-compute[74721]:       </nova:owner>
Nov 02 23:20:48 user nova-compute[74721]:       <nova:ports>
Nov 02 23:20:48 user nova-compute[74721]:         <nova:port uuid="48aa02d5-0025-4eb0-82e0-b7660e4ffd11">
Nov 02 23:20:48 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:20:48 user nova-compute[74721]:         </nova:port>
Nov 02 23:20:48 user nova-compute[74721]:       </nova:ports>
Nov 02 23:20:48 user nova-compute[74721]:     </nova:instance>
Nov 02 23:20:48 user nova-compute[74721]:   </metadata>
Nov 02 23:20:48 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:20:48 user nova-compute[74721]:     <system>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="serial">1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5</entry>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="uuid">1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5</entry>
Nov 02 23:20:48 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:20:48 user nova-compute[74721]:     </system>
Nov 02 23:20:48 user nova-compute[74721]:   </sysinfo>
Nov 02 23:20:48 user nova-compute[74721]:   <os>
Nov 02 23:20:48 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:20:48 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:20:48 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:20:48 user nova-compute[74721]:   </os>
Nov 02 23:20:48 user nova-compute[74721]:   <features>
Nov 02 23:20:48 user nova-compute[74721]:     <acpi/>
Nov 02 23:20:48 user nova-compute[74721]:     <apic/>
Nov 02 23:20:48 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:20:48 user nova-compute[74721]:   </features>
Nov 02 23:20:48 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:20:48 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:20:48 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:20:48 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:20:48 user nova-compute[74721]:   </clock>
Nov 02 23:20:48 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:20:48 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:20:48 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:20:48 user nova-compute[74721]:   </cpu>
Nov 02 23:20:48 user nova-compute[74721]:   <devices>
Nov 02 23:20:48 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:20:48 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:20:48 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:20:48 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:20:48 user nova-compute[74721]:       <serial>10196e6e-d89b-49a5-84f5-4a73e97301b3</serial>
Nov 02 23:20:48 user nova-compute[74721]:     </disk>
Nov 02 23:20:48 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:20:48 user nova-compute[74721]:       <mac address="fa:16:3e:f4:1a:11"/>
Nov 02 23:20:48 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:20:48 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:20:48 user nova-compute[74721]:       <target dev="tap48aa02d5-00"/>
Nov 02 23:20:48 user nova-compute[74721]:     </interface>
Nov 02 23:20:48 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:20:48 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5/console.log" append="off"/>
Nov 02 23:20:48 user nova-compute[74721]:     </serial>
Nov 02 23:20:48 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:20:48 user nova-compute[74721]:     <video>
Nov 02 23:20:48 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:20:48 user nova-compute[74721]:     </video>
Nov 02 23:20:48 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:20:48 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:20:48 user nova-compute[74721]:     </rng>
Nov 02 23:20:48 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:20:48 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:20:48 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:20:48 user nova-compute[74721]:     </memballoon>
Nov 02 23:20:48 user nova-compute[74721]:   </devices>
Nov 02 23:20:48 user nova-compute[74721]: </domain>
Nov 02 23:20:48 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1859595536',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5JgMri7zoT37QPEZ9Ep5w7T4eXAgf5aRXJlKMmP+vEDQqPwiPKazue0iwQz8scmNcuMrFUidvuJAObE7noDfD9HlmBUwA89RLelJiLiF2sPScrWPMuJqGT+cXGQM/m9Q==',key_name='tempest-keypair-749712009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pn3gwn0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG os_vif [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd550e02b-19ec-5786-a74e-32cd4b015cf2', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48aa02d5-00, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48aa02d5-00, col_values=(('qos', UUID('d5f0ede0-0ad1-40f4-8364-c2bb99537b64')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48aa02d5-00, col_values=(('external_ids', {'iface-id': '48aa02d5-0025-4eb0-82e0-b7660e4ffd11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:1a:11', 'vm-uuid': '1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:48 user nova-compute[74721]: INFO os_vif [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00')
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:20:48 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:f4:1a:11, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] No waiting events found dispatching network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:50 user nova-compute[74721]: WARNING nova.compute.manager [req-7043f563-64c0-4b37-b6be-3242a076886e req-ed87213f-fe7c-44cc-b597-dd6c5843e5a9 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received unexpected event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 for instance with vm_state building and task_state spawning.
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:20:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Instance spawned successfully.
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] No waiting events found dispatching network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:52 user nova-compute[74721]: WARNING nova.compute.manager [req-9fe6a9f8-10a7-4b93-9e15-01a6ef352fa3 req-acc5a725-ad82-4dc4-b763-783eff543924 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received unexpected event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 for instance with vm_state building and task_state spawning.
Nov 02 23:20:52 user nova-compute[74721]: INFO nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:20:52 user nova-compute[74721]: INFO nova.compute.manager [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Took 37.48 seconds to build instance.
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-d5552513-cd5a-479f-acaf-abf0fbceb500 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.751s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:52 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:53 user nova-compute[74721]: INFO nova.compute.manager [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Terminating instance
Nov 02 23:20:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:20:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-unplugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Acquiring lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] No waiting events found dispatching network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:20:54 user nova-compute[74721]: WARNING nova.compute.manager [req-e370eab3-e4bc-4f17-ae0c-d13c8da49a85 req-6b694266-4b57-4e4e-a2a4-0ed7faa4f483 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received unexpected event network-vif-plugged-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 for instance with vm_state active and task_state deleting.
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Instance destroyed successfully.
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'resources' on Instance uuid ee1c3ce6-0281-46ae-98c3-df163d075533 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-774356443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-774356443',id=33,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMALd36Qxsw8QMp5xI5aCMKDyO1mL9mLSl51t6QQ4wB6n9ydImx6hZXuP8j7NKK08DXKswKD5OXgkt9MnbEeeG7ochwLXWxPHwmkZaQJy6LFsFIcCzPnoxjrqNw7AC28SA==',key_name='tempest-keypair-688781644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-fz8ho8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=ee1c3ce6-0281-46ae-98c3-df163d075533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "address": "fa:16:3e:f9:ef:9f", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bd5cff-87", "ovs_interfaceid": "d2bd5cff-877a-4067-a204-8ab9bf8bf6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG os_vif [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2bd5cff-87, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01dc4d9d-e1c4-4137-a52e-1430fa9f2d86) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:20:54 user nova-compute[74721]: INFO os_vif [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ef:9f,bridge_name='br-int',has_traffic_filtering=True,id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bd5cff-87')
Nov 02 23:20:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Deleting instance files /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533_del
Nov 02 23:20:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Deletion of /opt/stack/data/nova/instances/ee1c3ce6-0281-46ae-98c3-df163d075533_del complete
Nov 02 23:20:54 user nova-compute[74721]: INFO nova.compute.manager [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 02 23:20:54 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:20:54 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:56 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Took 1.23 seconds to deallocate network for instance.
Nov 02 23:20:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-111c012d-7fdd-4314-ae03-20480912e7f4 req-1be5885d-845f-4c8a-802c-082230ac7ae2 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Received event network-vif-deleted-d2bd5cff-877a-4067-a204-8ab9bf8bf6a9 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:20:56 user nova-compute[74721]: INFO nova.compute.manager [req-111c012d-7fdd-4314-ae03-20480912e7f4 req-1be5885d-845f-4c8a-802c-082230ac7ae2 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Neutron deleted interface d2bd5cff-877a-4067-a204-8ab9bf8bf6a9; detaching it from the instance and deleting it from the info cache
Nov 02 23:20:56 user nova-compute[74721]: DEBUG nova.network.neutron [req-111c012d-7fdd-4314-ae03-20480912e7f4 req-1be5885d-845f-4c8a-802c-082230ac7ae2 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG nova.compute.manager [req-111c012d-7fdd-4314-ae03-20480912e7f4 req-1be5885d-845f-4c8a-802c-082230ac7ae2 service nova] [instance: ee1c3ce6-0281-46ae-98c3-df163d075533] Detach interface failed, port_id=d2bd5cff-877a-4067-a204-8ab9bf8bf6a9, reason: Instance ee1c3ce6-0281-46ae-98c3-df163d075533 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:20:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:56 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:20:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=25.104907989501953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:20:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.814s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.328s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:20:57 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Deleted allocations for instance ee1c3ce6-0281-46ae-98c3-df163d075533
Nov 02 23:20:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cf610693-2dd8-4490-9d0e-5820974e096d tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "ee1c3ce6-0281-46ae-98c3-df163d075533" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.392s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:20:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdTFeJKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:20:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:59 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:20:59 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dbb417-c712-4599-9af5-5009bff59bdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:20:59 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c8926-573c-4e7c-ab20-7fe5c9ed7d02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05] added
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ede0f-9581-4bab-89db-26da4d2ba984]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ddc75b-50da-4c85-a860-3a1320ec8a3b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdTFeJKS {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdTFeJKS" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeea7e9-d916-4619-bd82-c6f0dd106fb8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdTFeJKS'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4035ae0-8d51-4ab9-8856-42b336d5f691]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac14eff-17ea-4a16-8f52-7dd02f17a16b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[766527d0-2e8f-41d9-a1d0-495d29c9e0b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260]
Nov 02 23:20:59 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260] successful.
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7842d817-27a9-42e4-96e8-27f44f394186]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[67354540-b592-4c70-bbfb-f9a95c02454c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:20:59 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec4544a-3bb3-4dc6-95a4-f7dd64841314]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdTFeJKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:20:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23330303834363766', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330303834363766', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.objects.instance [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:21:00 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:21:00 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:21:00 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:21:00 user nova-compute[74721]:   <serial>96dc1d85-c7e5-4b46-a0e8-9e234ecfff05</serial>
Nov 02 23:21:00 user nova-compute[74721]: </disk>
Nov 02 23:21:00 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:21:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] No VIF found with MAC fa:16:3e:ab:45:c5, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:21:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-903d2a21-91fe-4e52-9fb5-7f2e9fff5dfa tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.824s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing instance network info cache due to event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG nova.network.neutron [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:21:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updated VIF entry in instance network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:21:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fe4db10-666b-4f3f-8226-f61a70b3cae7 req-b87d9b1d-e24d-43bc-b206-0f496baa9733 service nova] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing instance network info cache due to event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:21:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updated VIF entry in instance network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-400a699a-b57a-4145-8d0d-b08117481b66 req-80487925-f74c-4774-a277-2703fbe3fbf1 service nova] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:08 user nova-compute[74721]: INFO nova.compute.manager [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Rebooting instance
Nov 02 23:21:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:08 user nova-compute[74721]: DEBUG nova.network.neutron [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:21:09 user nova-compute[74721]: DEBUG nova.network.neutron [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:09 user nova-compute[74721]: DEBUG nova.compute.manager [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:21:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-unplugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-unplugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:11 user nova-compute[74721]: WARNING nova.compute.manager [req-f1679176-aa14-4f62-a51c-241dfc4fcb6e req-887735ca-2269-4404-b7a7-0a4b8f7264fb service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-unplugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state active and task_state reboot_started.
Nov 02 23:21:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:12 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance shutdown successfully.
Nov 02 23:21:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:13 user nova-compute[74721]: WARNING nova.compute.manager [req-f994446a-dec5-4004-a434-1d7a9d44a551 req-32f07b15-5de0-4467-99d9-288b94a124e6 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state active and task_state reboot_started.
Nov 02 23:21:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:14 user nova-compute[74721]: INFO nova.compute.manager [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Unrescuing
Nov 02 23:21:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:21:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.objects.instance [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'flavor' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:15 user nova-compute[74721]: WARNING nova.compute.manager [req-2d9075db-0e0e-46a3-a31f-30a160fc2064 req-55e3c0af-ea8a-4f03-a2e0-c503fed1b5d6 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:21:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:15 user nova-compute[74721]: WARNING nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state active and task_state reboot_started.
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] No waiting events found dispatching network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:15 user nova-compute[74721]: WARNING nova.compute.manager [req-79e9e4f7-eaff-4887-b017-74ebe9335bd3 req-a7367cbc-3a48-49ed-9103-3e4c3a257f9b service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received unexpected event network-vif-plugged-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 for instance with vm_state active and task_state reboot_started.
Nov 02 23:21:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance destroyed successfully.
Nov 02 23:21:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance running successfully.
Nov 02 23:21:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance soft rebooted successfully.
Nov 02 23:21:16 user nova-compute[74721]: DEBUG nova.compute.manager [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:21:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-47992bb2-3977-4880-a1ec-998a543083b5 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.069s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:17 user nova-compute[74721]: WARNING nova.compute.manager [req-a1b7e19a-ba84-48ad-a18b-dd5bf471826c req-599a2ed8-77fe-4fb5-a0fa-6831d67664bd service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:21:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:21:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:19 user nova-compute[74721]: WARNING nova.compute.manager [req-1ac1ca1e-3e8c-4026-80ff-c9bb822f39c5 req-cdd76baf-0469-4ff8-9fdc-2614fea30e1a service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:21:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-18ac7ff8-170b-49a7-adc6-700993bde113 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:21:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:37 user nova-compute[74721]: INFO nova.compute.manager [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Rescuing
Nov 02 23:21:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:21:37 user nova-compute[74721]: DEBUG nova.network.neutron [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG nova.compute.manager [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:38 user nova-compute[74721]: WARNING nova.compute.manager [req-46aeece9-aa5e-424c-815f-9c542dbf19fc req-c5881e82-262c-443d-85e3-972bcc843b31 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state active and task_state rescuing.
Nov 02 23:21:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance destroyed successfully.
Nov 02 23:21:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Attempting a stable device rescue
Nov 02 23:21:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:21:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Creating image(s)
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'trusted_certs' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:38 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:39 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.images [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] 3c563039-2a5d-46e2-b846-2706cac48d7e was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.part /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.part /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.converted" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:40 user nova-compute[74721]: WARNING nova.compute.manager [req-63ed5db4-4d26-4ba4-b7ec-e7a85c1a025e req-fe435c48-80f4-4646-babd-f87052872b98 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state active and task_state rescuing.
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b,backing_fmt=raw /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b,backing_fmt=raw /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue" returned: 0 in 0.052s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "ed37f670db4a9ccf9a5263ffa5562a81018ff87b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'migration_context' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<b120c949-845c-47ad-a10b-602434960dae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start _get_guest_xml network_info=[{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:07:cc:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3c563039-2a5d-46e2-b846-2706cac48d7e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '162a6a19-26b7-4ae7-8dd7-54d36b8f9bc9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b120c949-845c-47ad-a10b-602434960dae', 'attached_at': '', 'detached_at': '', 'volume_id': '066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'serial': '066831a7-b79c-4fdd-86c1-16a0a4cceb39'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<b120c949-845c-47ad-a10b-602434960dae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'numa_topology' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<b120c949-845c-47ad-a10b-602434960dae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:21:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:40 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'vcpu_model' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.objects.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<b120c949-845c-47ad-a10b-602434960dae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:21:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:21:40 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:21:40 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c289340-ec6f-4628-8a34-3e144f212841]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wgdtDLEn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 23:21:40 user nova-compute[74721]: node.name = iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:21:40 user nova-compute[74721]: node.tpgt = -1
Nov 02 23:21:40 user nova-compute[74721]: node.startup = automatic
Nov 02 23:21:40 user nova-compute[74721]: node.leading_login = No
Nov 02 23:21:40 user nova-compute[74721]: iface.iscsi_ifacename = default
Nov 02 23:21:40 user nova-compute[74721]: iface.net_ifacename = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.ipaddress = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.prefix_len = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.hwaddress = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.transport_name = tcp
Nov 02 23:21:40 user nova-compute[74721]: iface.initiatorname = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.vlan_id = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.vlan_priority = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.vlan_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.iface_num = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.mtu = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.port = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.bootproto = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.subnet_mask = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.gateway = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_alt_client_id = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_dns = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_learn_iqn = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_vendor_id_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_vendor_id = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.dhcp_slp_da = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.fragmentation = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.gratuitous_arp = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.incoming_forwarding = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.tos_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.tos = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.ttl = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.delayed_ack = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.tcp_nagle = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.tcp_wsf_state = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.tcp_wsf = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.tcp_timer_scale = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.tcp_timestamp = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.redirect = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.def_task_mgmt_timeout = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.header_digest = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.data_digest = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.immediate_data = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.initial_r2t = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.data_seq_inorder = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.data_pdu_inorder = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.erl = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.max_receive_data_len = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.first_burst_len = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.max_outstanding_r2t = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.max_burst_len = 0
Nov 02 23:21:40 user nova-compute[74721]: iface.chap_auth = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.bidi_chap = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.strict_login_compliance = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.discovery_auth = <empty>
Nov 02 23:21:40 user nova-compute[74721]: iface.discovery_logout = <empty>
Nov 02 23:21:40 user nova-compute[74721]: node.discovery_address = <empty>
Nov 02 23:21:40 user nova-compute[74721]: node.discovery_port = 0
Nov 02 23:21:40 user nova-compute[74721]: node.discovery_type = static
Nov 02 23:21:40 user nova-compute[74721]: node.session.initial_cmdsn = 0
Nov 02 23:21:40 user nova-compute[74721]: node.session.initial_login_retry_max = 8
Nov 02 23:21:40 user nova-compute[74721]: node.session.xmit_thread_priority = -20
Nov 02 23:21:40 user nova-compute[74721]: node.session.cmds_max = 128
Nov 02 23:21:40 user nova-compute[74721]: node.session.queue_depth = 32
Nov 02 23:21:40 user nova-compute[74721]: node.session.nr_sessions = 1
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.authmethod = CHAP
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.username = wgdtDLEn
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.password = ***
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.username_in = <empty>
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.password_in = <empty>
Nov 02 23:21:40 user nova-compute[74721]: node.session.auth.chap_algs = MD5
Nov 02 23:21:40 user nova-compute[74721]: node.session.timeo.replacement_timeout = 120
Nov 02 23:21:40 user nova-compute[74721]: node.session.err_timeo.abort_timeout = 15
Nov 02 23:21:40 user nova-compute[74721]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 23:21:40 user nova-compute[74721]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 23:21:40 user nova-compute[74721]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.FastAbort = Yes
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.InitialR2T = No
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.ImmediateData = Yes
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.MaxConnections = 1
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 23:21:40 user nova-compute[74721]: node.session.iscsi.ERL = 0
Nov 02 23:21:40 user nova-compute[74721]: node.session.scan = manual
Nov 02 23:21:40 user nova-compute[74721]: node.session.reopen_max = 0
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].address = 172.16.0.220
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].port = 3260
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].startup = manual
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].tcp.window_size = 524288
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].tcp.type_of_service = 0
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].timeo.logout_timeout = 15
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].timeo.login_timeout = 15
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].timeo.auth_timeout = 45
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.DataDigest = None
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.IFMarker = No
Nov 02 23:21:40 user nova-compute[74721]: node.conn[0].iscsi.OFMarker = No
Nov 02 23:21:40 user nova-compute[74721]: # END RECORD
Nov 02 23:21:40 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c31aa2-5a1b-426d-b4d5-aa9bc9667281]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ea9fe-4403-4b44-80c9-b37e706a26c9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgdtDLEn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgdtDLEn" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2330710-7a34-4db9-ba44-75e7d4205a96]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgdtDLEn'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e74d7e-f580-409b-99fa-1054f5b2ec97]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:21:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7e9b71-a406-46fc-83a6-1ecd9cc3d7d5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:21:41 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] HCTL ('33', '0', '0', 0) found on session 50 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[754bc4a7-a563-4570-a386-016480716c45]: (4, ('0 0 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching for a device in session 50 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26565393536376131', 'path': '/dev/sdb'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565393536376131', 'path': '/dev/sdb'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179948648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179948648',id=40,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-0zhn1xs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:20:35Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=b120c949-845c-47ad-a10b-602434960dae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:07:cc:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:07:cc:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.objects.base [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<b120c949-845c-47ad-a10b-602434960dae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:21:41 user nova-compute[74721]:   <uuid>b120c949-845c-47ad-a10b-602434960dae</uuid>
Nov 02 23:21:41 user nova-compute[74721]:   <name>instance-00000028</name>
Nov 02 23:21:41 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:21:41 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:21:41 user nova-compute[74721]:   <metadata>
Nov 02 23:21:41 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:21:41 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-179948648</nova:name>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:21:40</nova:creationTime>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:21:41 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:21:41 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:owner>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:21:41 user nova-compute[74721]:       </nova:owner>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:21:41 user nova-compute[74721]:       <nova:ports>
Nov 02 23:21:41 user nova-compute[74721]:         <nova:port uuid="73a2c67c-8320-4a37-8512-cdcfcfcaf992">
Nov 02 23:21:41 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 23:21:41 user nova-compute[74721]:         </nova:port>
Nov 02 23:21:41 user nova-compute[74721]:       </nova:ports>
Nov 02 23:21:41 user nova-compute[74721]:     </nova:instance>
Nov 02 23:21:41 user nova-compute[74721]:   </metadata>
Nov 02 23:21:41 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:21:41 user nova-compute[74721]:     <system>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="serial">b120c949-845c-47ad-a10b-602434960dae</entry>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="uuid">b120c949-845c-47ad-a10b-602434960dae</entry>
Nov 02 23:21:41 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:21:41 user nova-compute[74721]:     </system>
Nov 02 23:21:41 user nova-compute[74721]:   </sysinfo>
Nov 02 23:21:41 user nova-compute[74721]:   <os>
Nov 02 23:21:41 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:21:41 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:21:41 user nova-compute[74721]:   </os>
Nov 02 23:21:41 user nova-compute[74721]:   <features>
Nov 02 23:21:41 user nova-compute[74721]:     <acpi/>
Nov 02 23:21:41 user nova-compute[74721]:     <apic/>
Nov 02 23:21:41 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:21:41 user nova-compute[74721]:   </features>
Nov 02 23:21:41 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:21:41 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:21:41 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:21:41 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:21:41 user nova-compute[74721]:   </clock>
Nov 02 23:21:41 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:21:41 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:21:41 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:21:41 user nova-compute[74721]:   </cpu>
Nov 02 23:21:41 user nova-compute[74721]:   <devices>
Nov 02 23:21:41 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:21:41 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:21:41 user nova-compute[74721]:       <source dev="/dev/sdb"/>
Nov 02 23:21:41 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:21:41 user nova-compute[74721]:       <serial>066831a7-b79c-4fdd-86c1-16a0a4cceb39</serial>
Nov 02 23:21:41 user nova-compute[74721]:     </disk>
Nov 02 23:21:41 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:21:41 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:21:41 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue"/>
Nov 02 23:21:41 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:21:41 user nova-compute[74721]:       <boot order="1"/>
Nov 02 23:21:41 user nova-compute[74721]:     </disk>
Nov 02 23:21:41 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:21:41 user nova-compute[74721]:       <mac address="fa:16:3e:07:cc:c9"/>
Nov 02 23:21:41 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:21:41 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:21:41 user nova-compute[74721]:       <target dev="tap73a2c67c-83"/>
Nov 02 23:21:41 user nova-compute[74721]:     </interface>
Nov 02 23:21:41 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:21:41 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/console.log" append="off"/>
Nov 02 23:21:41 user nova-compute[74721]:     </serial>
Nov 02 23:21:41 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:21:41 user nova-compute[74721]:     <video>
Nov 02 23:21:41 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:21:41 user nova-compute[74721]:     </video>
Nov 02 23:21:41 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:21:41 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:21:41 user nova-compute[74721]:     </rng>
Nov 02 23:21:41 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:21:41 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:21:41 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:21:41 user nova-compute[74721]:     </memballoon>
Nov 02 23:21:41 user nova-compute[74721]:   </devices>
Nov 02 23:21:41 user nova-compute[74721]: </domain>
Nov 02 23:21:41 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:21:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance destroyed successfully.
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:07:cc:c9, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:21:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:42 user nova-compute[74721]: DEBUG nova.compute.manager [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:42 user nova-compute[74721]: WARNING nova.compute.manager [req-989adf2c-2b20-40cc-95ef-fe1b7a2f95f0 req-7beccbef-8b77-4673-adb2-dc9aa2902365 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state active and task_state rescuing.
Nov 02 23:21:44 user nova-compute[74721]: DEBUG nova.compute.manager [None req-da3e3e79-663d-4d11-acda-8486e42f69a0 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:21:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:44 user nova-compute[74721]: DEBUG nova.compute.manager [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:44 user nova-compute[74721]: WARNING nova.compute.manager [req-cabb4ef8-30ec-40e7-b35f-13a59fc1417a req-a47fd4ab-5b26-4c45-a019-f5e5e6f81691 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state rescued and task_state None.
Nov 02 23:21:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:21:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:21:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:21:48 user nova-compute[74721]: INFO nova.compute.claims [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Claim successful on node user
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:21:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.policy [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8116c488ed184fd2ace8fdbe0845d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca645902e8740fd909d3d90bbc62b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:21:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Creating image(s)
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.240s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk 1073741824" returned: 0 in 0.055s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Successfully created port: 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Cannot resize image /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Ensure instance console log exists: /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Successfully updated port: 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing instance network info cache due to event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance network_info: |[{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start _get_guest_xml network_info=[{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:21:51 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:51 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5ecrvhsqkqbRPidyokzNG80X82YjyUzwRidl4+95lsQ13nJXFzndK70XKYP9Km/QMrfwDO5bxIyEmtMzGHY7Ue1/B7zaGu9nyMBmLl7MLm5SItCZJx9Amp3tF5N9aQOg==',key_name='tempest-keypair-1744192280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:21:51 user nova-compute[74721]:   <uuid>2d17a40c-b25a-48b5-a23b-f06f0433c2ac</uuid>
Nov 02 23:21:51 user nova-compute[74721]:   <name>instance-0000002a</name>
Nov 02 23:21:51 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:21:51 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:21:51 user nova-compute[74721]:   <metadata>
Nov 02 23:21:51 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:21:51 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-627122911</nova:name>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:21:51</nova:creationTime>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:21:51 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:21:51 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:owner>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:user uuid="8116c488ed184fd2ace8fdbe0845d033">tempest-AttachVolumeShelveTestJSON-110193585-project-member</nova:user>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:project uuid="eca645902e8740fd909d3d90bbc62b01">tempest-AttachVolumeShelveTestJSON-110193585</nova:project>
Nov 02 23:21:51 user nova-compute[74721]:       </nova:owner>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:21:51 user nova-compute[74721]:       <nova:ports>
Nov 02 23:21:51 user nova-compute[74721]:         <nova:port uuid="32bf4098-0dd2-430b-8916-ecf5c536b154">
Nov 02 23:21:51 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 23:21:51 user nova-compute[74721]:         </nova:port>
Nov 02 23:21:51 user nova-compute[74721]:       </nova:ports>
Nov 02 23:21:51 user nova-compute[74721]:     </nova:instance>
Nov 02 23:21:51 user nova-compute[74721]:   </metadata>
Nov 02 23:21:51 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:21:51 user nova-compute[74721]:     <system>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="serial">2d17a40c-b25a-48b5-a23b-f06f0433c2ac</entry>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="uuid">2d17a40c-b25a-48b5-a23b-f06f0433c2ac</entry>
Nov 02 23:21:51 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:21:51 user nova-compute[74721]:     </system>
Nov 02 23:21:51 user nova-compute[74721]:   </sysinfo>
Nov 02 23:21:51 user nova-compute[74721]:   <os>
Nov 02 23:21:51 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:21:51 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:21:51 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:21:51 user nova-compute[74721]:   </os>
Nov 02 23:21:51 user nova-compute[74721]:   <features>
Nov 02 23:21:51 user nova-compute[74721]:     <acpi/>
Nov 02 23:21:51 user nova-compute[74721]:     <apic/>
Nov 02 23:21:51 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:21:51 user nova-compute[74721]:   </features>
Nov 02 23:21:51 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:21:51 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:21:51 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:21:51 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:21:51 user nova-compute[74721]:   </clock>
Nov 02 23:21:51 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:21:51 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:21:51 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:21:51 user nova-compute[74721]:   </cpu>
Nov 02 23:21:51 user nova-compute[74721]:   <devices>
Nov 02 23:21:51 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:21:51 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:21:51 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk"/>
Nov 02 23:21:51 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:21:51 user nova-compute[74721]:     </disk>
Nov 02 23:21:51 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:21:51 user nova-compute[74721]:       <mac address="fa:16:3e:fb:0f:61"/>
Nov 02 23:21:51 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:21:51 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:21:51 user nova-compute[74721]:       <target dev="tap32bf4098-0d"/>
Nov 02 23:21:51 user nova-compute[74721]:     </interface>
Nov 02 23:21:51 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:21:51 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/console.log" append="off"/>
Nov 02 23:21:51 user nova-compute[74721]:     </serial>
Nov 02 23:21:51 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:21:51 user nova-compute[74721]:     <video>
Nov 02 23:21:51 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:21:51 user nova-compute[74721]:     </video>
Nov 02 23:21:51 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:21:51 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:21:51 user nova-compute[74721]:     </rng>
Nov 02 23:21:51 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:21:51 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:21:51 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:21:51 user nova-compute[74721]:     </memballoon>
Nov 02 23:21:51 user nova-compute[74721]:   </devices>
Nov 02 23:21:51 user nova-compute[74721]: </domain>
Nov 02 23:21:51 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5ecrvhsqkqbRPidyokzNG80X82YjyUzwRidl4+95lsQ13nJXFzndK70XKYP9Km/QMrfwDO5bxIyEmtMzGHY7Ue1/B7zaGu9nyMBmLl7MLm5SItCZJx9Amp3tF5N9aQOg==',key_name='tempest-keypair-1744192280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG os_vif [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cdf2dc0-562d-5d74-8ade-8e509b25b5f2', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32bf4098-0d, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32bf4098-0d, col_values=(('qos', UUID('ccf810d3-7da6-44ce-b690-012171f37f88')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32bf4098-0d, col_values=(('external_ids', {'iface-id': '32bf4098-0dd2-430b-8916-ecf5c536b154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:0f:61', 'vm-uuid': '2d17a40c-b25a-48b5-a23b-f06f0433c2ac'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:51 user nova-compute[74721]: INFO os_vif [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d')
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No VIF found with MAC fa:16:3e:fb:0f:61, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updated VIF entry in instance network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:21:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bcda2135-0865-4735-94b2-1e5e9208e15e req-9edea6b5-848e-43c9-a46d-cf48f0533e4c service nova] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:21:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:53 user nova-compute[74721]: WARNING nova.compute.manager [req-de998ad7-56e4-46ab-bf89-b8aa72c9955d req-d0e16d0e-af32-4694-983f-fb4d7d5d9c50 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state building and task_state spawning.
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:53 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:21:55 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance spawned successfully.
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:21:55 user nova-compute[74721]: INFO nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:55 user nova-compute[74721]: INFO nova.compute.manager [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Took 7.28 seconds to build instance.
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-741f99e1-a08a-4146-b272-5e2a63ef2bd3 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.396s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:21:55 user nova-compute[74721]: WARNING nova.compute.manager [req-d50c4856-85e9-4950-b89e-4907ebd6f43e req-5b5cb33b-862b-4d99-98ca-2e9db4ce434f service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state active and task_state None.
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:55 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:21:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:21:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:21:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=25.02301025390625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:21:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:22:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:22:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-changed-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Refreshing instance network info cache due to event network-changed-48aa02d5-0025-4eb0-82e0-b7660e4ffd11. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] Acquiring lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] Acquired lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Refreshing network info cache for port 48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updated VIF entry in instance network info cache for port 48aa02d5-0025-4eb0-82e0-b7660e4ffd11. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updating instance_info_cache with network_info: [{"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a044310-1cf8-481a-b076-98a9e9e66ee7 req-f671d4f3-821c-4076-a642-4229874fdda6 service nova] Releasing lock "refresh_cache-1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:22:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:22:21 user nova-compute[74721]: INFO nova.compute.claims [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Claim successful on node user
Nov 02 23:22:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:22:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:22:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:22:22 user nova-compute[74721]: INFO nova.virt.block_device [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Booting with volume snapshot 2db67669-6e52-4faf-ad5c-8566f3fdb02e at /dev/vda
Nov 02 23:22:22 user nova-compute[74721]: DEBUG nova.policy [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:22:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Successfully created port: 2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Successfully updated port: 2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-changed-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.compute.manager [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Refreshing instance network info cache due to event network-changed-2712d5f6-8cce-499c-863f-aaa8844acedd. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] Acquiring lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updating instance_info_cache with network_info: [{"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Instance network_info: |[{"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] Acquired lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:22:23 user nova-compute[74721]: DEBUG nova.network.neutron [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Refreshing network info cache for port 2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:22:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updated VIF entry in instance network info cache for port 2712d5f6-8cce-499c-863f-aaa8844acedd. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:22:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updating instance_info_cache with network_info: [{"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:22:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a6ff0559-7141-474b-a9b1-a2a5f41f89ad req-1638e8fc-5d85-4270-9d0a-65a4df618eca service nova] Releasing lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:22:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:22:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681fcb2-bb68-4eae-9fd0-8a2feed24d1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a1d40-9b07-41fe-91a1-7fc6fbc2ff2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b5e7ae-2028-4846-950e-21b37c21723e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49fba5-62ac-4757-ad84-dcb4fa7cdc7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:22:32 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:22:32 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dfb3df-c70e-41e7-ad43-3bd82d68dbf6]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG os_brick.utils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:22:32 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updating existing volume attachment record: d76d1198-0852-42b3-98dd-e9d4b36b9c17 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:22:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_power_states {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:40 user nova-compute[74721]: WARNING nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid e99953a1-4e40-4106-8749-62286bdcfe96 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "b120c949-845c-47ad-a10b-602434960dae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "b120c949-845c-47ad-a10b-602434960dae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:22:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [{"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-ed86a8bd-c846-431f-adf5-c990136d5e85" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:22:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:22:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:22:55 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:22:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:22:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:22:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:22:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=7866MB free_disk=24.98281478881836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance e99953a1-4e40-4106-8749-62286bdcfe96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:22:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing instance network info cache due to event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updated VIF entry in instance network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG nova.network.neutron [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4355e9fb-3dc0-4e79-9328-b89ef394eba1 req-78c770c9-d910-40c2-8e1b-0a00f4c673ca service nova] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing instance network info cache due to event network-changed-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] Acquiring lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] Acquired lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Refreshing network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:01 user nova-compute[74721]: INFO nova.compute.manager [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Detaching volume 96dc1d85-c7e5-4b46-a0e8-9e234ecfff05
Nov 02 23:23:01 user nova-compute[74721]: INFO nova.virt.block_device [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Attempting to driver detach volume 96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 from mountpoint /dev/vdb
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Attempting to detach device vdb from instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:23:01 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:23:01 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:23:01 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:23:01 user nova-compute[74721]:   <serial>96dc1d85-c7e5-4b46-a0e8-9e234ecfff05</serial>
Nov 02 23:23:01 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:23:01 user nova-compute[74721]: </disk>
Nov 02 23:23:01 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:23:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully detached device vdb from instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 from the persistent domain config.
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:23:01 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:23:01 user nova-compute[74721]:   <source dev="/dev/sdd"/>
Nov 02 23:23:01 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:23:01 user nova-compute[74721]:   <serial>96dc1d85-c7e5-4b46-a0e8-9e234ecfff05</serial>
Nov 02 23:23:01 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:23:01 user nova-compute[74721]: </disk>
Nov 02 23:23:01 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updated VIF entry in instance network info cache for port 07ba2295-e6c5-48cd-8fcc-0878f0dc3d06. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG nova.network.neutron [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [{"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-31f6fd34-8311-4272-973a-958fe35bc5d7 req-fb2752f8-0100-407a-b83d-5a55a798cd54 service nova] Releasing lock "refresh_cache-34ea2247-7f67-4ea0-b6fe-13826047d6d8" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing instance network info cache due to event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updated VIF entry in instance network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2c29e62a-af1b-455e-9ef1-81b237ac1330 req-9310fb90-ec6a-46bb-b36f-c703c88beb6f service nova] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:07 user nova-compute[74721]: INFO nova.compute.manager [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Detaching volume ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:23:07 user nova-compute[74721]: INFO nova.virt.block_device [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Attempting to driver detach volume ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 from mountpoint /dev/vdb
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Attempting to detach device vdb from instance 47459418-703e-46a3-bc42-b7034ee8af46 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:23:07 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:23:07 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:23:07 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:23:07 user nova-compute[74721]:   <serial>ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79</serial>
Nov 02 23:23:07 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:23:07 user nova-compute[74721]: </disk>
Nov 02 23:23:07 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:23:07 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully detached device vdb from instance 47459418-703e-46a3-bc42-b7034ee8af46 from the persistent domain config.
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47459418-703e-46a3-bc42-b7034ee8af46 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:23:07 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:23:07 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:23:07 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:23:07 user nova-compute[74721]:   <serial>ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79</serial>
Nov 02 23:23:07 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:23:07 user nova-compute[74721]: </disk>
Nov 02 23:23:07 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:23:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:23:08 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Creating image(s)
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Ensure instance console log exists: /opt/stack/data/nova/instances/e99953a1-4e40-4106-8749-62286bdcfe96/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Start _get_guest_xml network_info=[{"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T23:22:09Z,direct_url=<?>,disk_format='qcow2',id=dcdabd3c-5897-42a6-98be-79f46239757e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1594365853',owner='5e6fd03271be4da382c041846492b561',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T23:22:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'd76d1198-0852-42b3-98dd-e9d4b36b9c17', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSHZkIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e99953a1-4e40-4106-8749-62286bdcfe96', 'attached_at': '', 'detached_at': '', 'volume_id': '69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 'serial': '69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:23:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:23:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T23:22:09Z,direct_url=<?>,disk_format='qcow2',id=dcdabd3c-5897-42a6-98be-79f46239757e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1594365853',owner='5e6fd03271be4da382c041846492b561',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T23:22:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSHZkIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:23:08 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:23:08 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:23:08 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864710c-7e14-4be1-aba1-37be72a9000a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:23:08 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76b7b3-bb7f-45d9-a077-3a219b6f192d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd] added
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d41c0-d0ae-4512-981f-6dead99d871d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f23076-92a6-450c-b295-8ba5077a0446]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSHZkIue {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSHZkIue" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497a620-42b0-4c88-9062-df2cb26dbfe7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSHZkIue'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf496594-e169-4161-ba70-7ace065ac3c9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971ad87-470d-402c-be73-b25009b3d6ac]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa8f66-7b7c-4c66-be6c-31ba2ebbbc58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260]
Nov 02 23:23:08 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260] successful.
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76cbc8-683f-4d37-af31-772069376cde]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1eca6-b173-4377-80fd-8b7e7c555591]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:08 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:08 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('37', '-', '-', 0) found on session 53 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f42283-44d9-4e38-8a3e-420eb6918535]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing instance network info cache due to event network-changed-402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] Acquiring lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] Acquired lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:08 user nova-compute[74721]: DEBUG nova.network.neutron [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Refreshing network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.neutron [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updated VIF entry in instance network info cache for port 402d30fc-6fb0-4996-965d-8cc06efb456f. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.neutron [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [{"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3bff098c-aebb-47ab-8093-e72429b7425a req-e870e2e3-bb1c-4eff-a0dd-04d4d34f8fcf service nova] Releasing lock "refresh_cache-47459418-703e-46a3-bc42-b7034ee8af46" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSHZkIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23934396364343161', 'path': '/dev/sdf'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934396364343161', 'path': '/dev/sdf'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277857812',id=43,image_ref='dcdabd3c-5897-42a6-98be-79f46239757e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMvEYHCCClbbL3um3i6zPfe0t24uyRm5O093mIt8FrIls88YlA8MtosPLQ87XuyME/ls3kvdO3GOcWO3p2FOLsXxJXtRkw+Yq+UTFtjOGzCQX8XmQJBjkmsKb0KcwnYUg==',key_name='tempest-keypair-2012929091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-8abpcf04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1714088517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e99953a1-4e40-4106-8749-62286bdcfe96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.objects.instance [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid e99953a1-4e40-4106-8749-62286bdcfe96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:23:09 user nova-compute[74721]:   <uuid>e99953a1-4e40-4106-8749-62286bdcfe96</uuid>
Nov 02 23:23:09 user nova-compute[74721]:   <name>instance-0000002b</name>
Nov 02 23:23:09 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:23:09 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:23:09 user nova-compute[74721]:   <metadata>
Nov 02 23:23:09 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:23:09 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1277857812</nova:name>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:23:08</nova:creationTime>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:23:09 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:23:09 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:owner>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:23:09 user nova-compute[74721]:       </nova:owner>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:root type="image" uuid="dcdabd3c-5897-42a6-98be-79f46239757e"/>
Nov 02 23:23:09 user nova-compute[74721]:       <nova:ports>
Nov 02 23:23:09 user nova-compute[74721]:         <nova:port uuid="2712d5f6-8cce-499c-863f-aaa8844acedd">
Nov 02 23:23:09 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 23:23:09 user nova-compute[74721]:         </nova:port>
Nov 02 23:23:09 user nova-compute[74721]:       </nova:ports>
Nov 02 23:23:09 user nova-compute[74721]:     </nova:instance>
Nov 02 23:23:09 user nova-compute[74721]:   </metadata>
Nov 02 23:23:09 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:23:09 user nova-compute[74721]:     <system>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="serial">e99953a1-4e40-4106-8749-62286bdcfe96</entry>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="uuid">e99953a1-4e40-4106-8749-62286bdcfe96</entry>
Nov 02 23:23:09 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:23:09 user nova-compute[74721]:     </system>
Nov 02 23:23:09 user nova-compute[74721]:   </sysinfo>
Nov 02 23:23:09 user nova-compute[74721]:   <os>
Nov 02 23:23:09 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:23:09 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:23:09 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:23:09 user nova-compute[74721]:   </os>
Nov 02 23:23:09 user nova-compute[74721]:   <features>
Nov 02 23:23:09 user nova-compute[74721]:     <acpi/>
Nov 02 23:23:09 user nova-compute[74721]:     <apic/>
Nov 02 23:23:09 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:23:09 user nova-compute[74721]:   </features>
Nov 02 23:23:09 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:23:09 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:23:09 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:23:09 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:23:09 user nova-compute[74721]:   </clock>
Nov 02 23:23:09 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:23:09 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:23:09 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:23:09 user nova-compute[74721]:   </cpu>
Nov 02 23:23:09 user nova-compute[74721]:   <devices>
Nov 02 23:23:09 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:23:09 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:23:09 user nova-compute[74721]:       <source dev="/dev/sdf"/>
Nov 02 23:23:09 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:23:09 user nova-compute[74721]:       <serial>69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd</serial>
Nov 02 23:23:09 user nova-compute[74721]:     </disk>
Nov 02 23:23:09 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:23:09 user nova-compute[74721]:       <mac address="fa:16:3e:c6:75:6d"/>
Nov 02 23:23:09 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:23:09 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:23:09 user nova-compute[74721]:       <target dev="tap2712d5f6-8c"/>
Nov 02 23:23:09 user nova-compute[74721]:     </interface>
Nov 02 23:23:09 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:23:09 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/e99953a1-4e40-4106-8749-62286bdcfe96/console.log" append="off"/>
Nov 02 23:23:09 user nova-compute[74721]:     </serial>
Nov 02 23:23:09 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:23:09 user nova-compute[74721]:     <video>
Nov 02 23:23:09 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:23:09 user nova-compute[74721]:     </video>
Nov 02 23:23:09 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:23:09 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:23:09 user nova-compute[74721]:     </rng>
Nov 02 23:23:09 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:23:09 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:23:09 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:23:09 user nova-compute[74721]:     </memballoon>
Nov 02 23:23:09 user nova-compute[74721]:   </devices>
Nov 02 23:23:09 user nova-compute[74721]: </domain>
Nov 02 23:23:09 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277857812',id=43,image_ref='dcdabd3c-5897-42a6-98be-79f46239757e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMvEYHCCClbbL3um3i6zPfe0t24uyRm5O093mIt8FrIls88YlA8MtosPLQ87XuyME/ls3kvdO3GOcWO3p2FOLsXxJXtRkw+Yq+UTFtjOGzCQX8XmQJBjkmsKb0KcwnYUg==',key_name='tempest-keypair-2012929091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-8abpcf04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1714088517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e99953a1-4e40-4106-8749-62286bdcfe96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG os_vif [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dae85c34-e966-5c37-b024-dcffa9767d60', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2712d5f6-8c, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2712d5f6-8c, col_values=(('qos', UUID('b0a9a4b4-306c-474d-a79b-eb1c8ecb540e')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2712d5f6-8c, col_values=(('external_ids', {'iface-id': '2712d5f6-8cce-499c-863f-aaa8844acedd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:75:6d', 'vm-uuid': 'e99953a1-4e40-4106-8749-62286bdcfe96'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:09 user nova-compute[74721]: INFO os_vif [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c')
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:23:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:c6:75:6d, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:23:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] No waiting events found dispatching network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:11 user nova-compute[74721]: WARNING nova.compute.manager [req-d9274951-e115-47aa-bcce-640939874dea req-9cb5bc4d-5cf6-4afa-bd4f-0908335c94b5 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received unexpected event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd for instance with vm_state building and task_state spawning.
Nov 02 23:23:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:23:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Instance spawned successfully.
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:23:13 user nova-compute[74721]: INFO nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] No waiting events found dispatching network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:13 user nova-compute[74721]: WARNING nova.compute.manager [req-26740989-8ceb-4f2e-84f5-3a30622dc5b1 req-05c324b7-6d36-4057-a663-5e2b2e082d74 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received unexpected event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd for instance with vm_state building and task_state spawning.
Nov 02 23:23:13 user nova-compute[74721]: INFO nova.compute.manager [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Took 51.75 seconds to build instance.
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-891b33fa-b303-42b2-8ba3-1004467df029 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.847s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 32.664s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:13 user nova-compute[74721]: INFO nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 02 23:23:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:22 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 is timed out.
Nov 02 23:23:22 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully detached device vdb from instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 from the live domain config.
Nov 02 23:23:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdTFeJKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:23:22 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[611065f3-56ac-4182-8e19-2464e1c86f73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:23:22 user nova-compute[74721]: No targets found.
Nov 02 23:23:22 user nova-compute[74721]: iSNS:
Nov 02 23:23:22 user nova-compute[74721]: No targets found.
Nov 02 23:23:22 user nova-compute[74721]: STATIC:
Nov 02 23:23:22 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05
Nov 02 23:23:22 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:22 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:22 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd
Nov 02 23:23:22 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:22 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:22 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:23:22 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:22 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:22 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3
Nov 02 23:23:22 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:22 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:22 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:23:22 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:22 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:22 user nova-compute[74721]: FIRMWARE:
Nov 02 23:23:22 user nova-compute[74721]: No targets found.
Nov 02 23:23:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:23:22 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:23:22 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf41917-c749-489c-92ba-8613483866cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a732c92-e223-4b05-80b4-be30c7bc873f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 (non-flash)
Nov 02 23:23:22 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24172a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33930a-ae32-4195-a1e1-abd1e0559ed2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a2ef8-0ed5-4395-b4cf-b57fc46e6a78]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd4ccb-4e63-4aca-a636-d678dc53a465]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71f90c-3c33-4063-ac39-d49bdfcd90d1]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b52faf-209f-4b1a-9bf3-73c508cf04b1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c69d47-613f-4130-a241-63f4db6257f5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260]
Nov 02 23:23:22 user nova-compute[74721]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05, portal: 172.16.0.220,3260] successful.
Nov 02 23:23:22 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96dc1d85-c7e5-4b46-a0e8-9e234ecfff05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff95abda-f463-456b-84a6-446c5f96e632]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] <== disconnect_volume: return (350ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:23:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:23:23 user nova-compute[74721]: DEBUG nova.objects.instance [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'flavor' on Instance uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:23 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-dee54204-7a5a-4278-a612-af864949ff30 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47459418-703e-46a3-bc42-b7034ee8af46 is timed out.
Nov 02 23:23:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully detached device vdb from instance 47459418-703e-46a3-bc42-b7034ee8af46 from the live domain config.
Nov 02 23:23:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAWTfoyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:23:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70a292-d538-4f3c-bdd6-dc8f54d8b606]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:23:27 user nova-compute[74721]: No targets found.
Nov 02 23:23:27 user nova-compute[74721]: iSNS:
Nov 02 23:23:27 user nova-compute[74721]: No targets found.
Nov 02 23:23:27 user nova-compute[74721]: STATIC:
Nov 02 23:23:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd
Nov 02 23:23:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:23:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3
Nov 02 23:23:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:27 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79
Nov 02 23:23:27 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:23:27 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:23:27 user nova-compute[74721]: FIRMWARE:
Nov 02 23:23:27 user nova-compute[74721]: No targets found.
Nov 02 23:23:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:23:27 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:23:27 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1401b4-03ec-496f-8218-4f9d6cec8b92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8665bf-2dd6-4d3d-ba3c-48963c5c9bfa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:27 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:27 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:27 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 (non-flash)
Nov 02 23:23:28 user nova-compute[74721]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:23:28 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:23:28 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:23:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf242c2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2224a-ecd7-4fe9-b99b-a51230d77d6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feefe58-fbcd-46e5-a112-26a9db944586]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[75472a78-2fdb-4e8a-86de-41a716669209]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004dccc-6a2f-4cb6-9c14-362978342fbc]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbacf5e-131e-4f68-b343-daa2d4e991b3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd1262-d441-44a8-b248-6f766ef857a1]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260]
Nov 02 23:23:28 user nova-compute[74721]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79, portal: 172.16.0.220,3260] successful.
Nov 02 23:23:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc89e0e-d51d-4e6f-9a54-d5121dc2bf79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2fbb94-446c-4a40-abe8-568da35e442b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] <== disconnect_volume: return (315ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:23:28 user nova-compute[74721]: INFO nova.compute.manager [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Unrescuing
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:23:28 user nova-compute[74721]: DEBUG nova.network.neutron [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'flavor' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'flavor' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:29 user nova-compute[74721]: WARNING nova.compute.manager [req-fea77ae2-8d6a-4788-ad14-b0831a72357f req-cebf8b0c-dd49-4642-8bb8-781b86c5ed25 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:23:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e8040312-d000-4508-af74-8b127aa9e4e6 tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:29 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance destroyed successfully.
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:31 user nova-compute[74721]: WARNING nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:23:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:31 user nova-compute[74721]: WARNING nova.compute.manager [req-c696dec0-9b15-41ff-afeb-64df0e4695e4 req-9c7bc43e-619e-42de-88c7-033be31b6501 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:23:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-442bd282-756a-43a8-b891-068a65fb5998 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:33 user nova-compute[74721]: WARNING nova.compute.manager [req-7490ba75-4d31-45ae-b374-11238ac3f9af req-847aad1d-a17a-4830-a994-822ef66f608b service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state active and task_state None.
Nov 02 23:23:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing instance network info cache due to event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updated VIF entry in instance network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG nova.network.neutron [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3c3cf9a0-b427-4e0f-bf48-aab378c9c462 req-b59f3848-fabb-40ff-8fef-5f887c050bd2 service nova] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:45 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:45 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:23:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:45 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:46 user nova-compute[74721]: INFO nova.compute.manager [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Shelving
Nov 02 23:23:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [{"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-867bc1c7-5187-4d0e-949f-cd5c11c1159e" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:46 user nova-compute[74721]: WARNING nova.compute.manager [req-a32ae5eb-f6e3-43ad-8d33-94685aa7d0e4 req-14dd7fca-c7db-4382-920c-5785b6e97f13 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state active and task_state shelving.
Nov 02 23:23:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance destroyed successfully.
Nov 02 23:23:46 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Beginning cold snapshot process
Nov 02 23:23:47 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:23:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk /opt/stack/data/nova/instances/snapshots/tmplw60oyyv/b8d3b57dedd444b685cf24f51b671663 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:47 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk /opt/stack/data/nova/instances/snapshots/tmplw60oyyv/b8d3b57dedd444b685cf24f51b671663" returned: 0 in 0.791s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Snapshot extracted, beginning image upload
Nov 02 23:23:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:48 user nova-compute[74721]: WARNING nova.compute.manager [req-784c4aa2-ecf7-4f4e-a5aa-9bc094a8fbfb req-d178378c-01c3-4cb9-b507-5b9748d0cc29 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 23:23:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Snapshot image upload complete
Nov 02 23:23:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:23:50 user nova-compute[74721]: INFO nova.compute.manager [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Shelve offloading
Nov 02 23:23:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance destroyed successfully.
Nov 02 23:23:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:23:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:23:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance destroyed successfully.
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'resources' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5ecrvhsqkqbRPidyokzNG80X82YjyUzwRidl4+95lsQ13nJXFzndK70XKYP9Km/QMrfwDO5bxIyEmtMzGHY7Ue1/B7zaGu9nyMBmLl7MLm5SItCZJx9Amp3tF5N9aQOg==',key_name='tempest-keypair-1744192280',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:23:50.311658',shelved_host='user',shelved_image_id='7c2a2b25-ae81-4ba4-91cb-a96030876cb1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG os_vif [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.compute.manager [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing instance network info cache due to event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32bf4098-0d, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccf810d3-7da6-44ce-b690-012171f37f88) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:51 user nova-compute[74721]: INFO os_vif [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d')
Nov 02 23:23:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Deleting instance files /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac_del
Nov 02 23:23:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Deletion of /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac_del complete
Nov 02 23:23:51 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Deleted allocations for instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.objects.base [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<2d17a40c-b25a-48b5-a23b-f06f0433c2ac> lazy-loaded attributes: resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updated VIF entry in instance network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.network.neutron [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap32bf4098-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01364ec6-7595-474c-9056-820eb0439e0a req-76774341-d556-4d94-b9da-add086875ae5 service nova] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-f3b43891-1947-432d-b73b-2e97239311ac tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.683s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:23:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:55 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:58 user nova-compute[74721]: INFO nova.compute.manager [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Terminating instance
Nov 02 23:23:58 user nova-compute[74721]: DEBUG nova.compute.manager [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-39de3aaa-6168-48d0-93b1-a7ca1aa0e4f6 req-72a2bb2d-9db9-4fd9-b857-d4aa41ce3a7e service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-unplugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:23:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:23:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8058MB free_disk=24.959613800048828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:23:59 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Instance destroyed successfully.
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.objects.instance [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid 47459418-703e-46a3-bc42-b7034ee8af46 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606480863',display_name='tempest-ServerRescueNegativeTestJSON-server-606480863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606480863',id=36,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZtwikCAcxIuESk9O23FU5EtdfS+/vVWL0PgZOOvpbCMg6V/MhBHwLfozhAXcDP2kN8wrz1Fmp/L/hK5ip3bYocAIZA3/ABnG2p6WE9DphcTzLQzAXXdv51+4WNYyFhw==',key_name='tempest-keypair-1005684426',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:19:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-vg70b9bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=47459418-703e-46a3-bc42-b7034ee8af46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "402d30fc-6fb0-4996-965d-8cc06efb456f", "address": "fa:16:3e:53:23:3a", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402d30fc-6f", "ovs_interfaceid": "402d30fc-6fb0-4996-965d-8cc06efb456f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG os_vif [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap402d30fc-6f, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71ffb4fa-8319-4c4c-997f-638dc6eb8f69) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:23:59 user nova-compute[74721]: INFO os_vif [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:23:3a,bridge_name='br-int',has_traffic_filtering=True,id=402d30fc-6fb0-4996-965d-8cc06efb456f,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402d30fc-6f')
Nov 02 23:23:59 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Deleting instance files /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46_del
Nov 02 23:23:59 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Deletion of /opt/stack/data/nova/instances/47459418-703e-46a3-bc42-b7034ee8af46_del complete
Nov 02 23:23:59 user nova-compute[74721]: INFO nova.compute.manager [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 23:23:59 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 47459418-703e-46a3-bc42-b7034ee8af46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance e99953a1-4e40-4106-8749-62286bdcfe96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:23:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:24:00 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Took 1.01 seconds to deallocate network for instance.
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] Acquiring lock "47459418-703e-46a3-bc42-b7034ee8af46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] Lock "47459418-703e-46a3-bc42-b7034ee8af46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] No waiting events found dispatching network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:24:00 user nova-compute[74721]: WARNING nova.compute.manager [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received unexpected event network-vif-plugged-402d30fc-6fb0-4996-965d-8cc06efb456f for instance with vm_state deleted and task_state None.
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-b67b4105-dfff-4a3e-9116-4b899a5928fe req-8e92f8ce-c95b-4c2d-8daf-2fe72e1c2af7 service nova] [instance: 47459418-703e-46a3-bc42-b7034ee8af46] Received event network-vif-deleted-402d30fc-6fb0-4996-965d-8cc06efb456f {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:00 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Deleted allocations for instance 47459418-703e-46a3-bc42-b7034ee8af46
Nov 02 23:24:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-00b9f43c-73d4-4ddf-9c64-dc8e15920d9f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "47459418-703e-46a3-bc42-b7034ee8af46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:03 user nova-compute[74721]: INFO nova.compute.manager [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Terminating instance
Nov 02 23:24:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Instance destroyed successfully.
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lazy-loading 'resources' on Instance uuid 34ea2247-7f67-4ea0-b6fe-13826047d6d8 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607078100',display_name='tempest-TestMinimumBasicScenario-server-607078100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607078100',id=39,image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLzAhBIvoqF8r8cJKXQfqv2C+rEu5UqtPKm+KmRNUud+YUVy8mLTk3tB60AWpKS5SL3ZXiL/ytdd901f1IH6PZnIR+UrT7FeF58SztU4gF8TF3CjXWsjOVTlHtanQo9uA==',key_name='tempest-TestMinimumBasicScenario-1653010718',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e6216758d9b4e8abdb1840710239900',ramdisk_id='',reservation_id='r-b2rihbnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4bd92455-f456-4c45-b677-7630f87d0e7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-493864842',owner_user_name='tempest-TestMinimumBasicScenario-493864842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:21:17Z,user_data=None,user_id='2dc6f5e5ea0d4089998a6b8bff41c488',uuid=34ea2247-7f67-4ea0-b6fe-13826047d6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converting VIF {"id": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "address": "fa:16:3e:ab:45:c5", "network": {"id": "5b30b696-9410-46ad-b466-ba0740dd664c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1823471237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e6216758d9b4e8abdb1840710239900", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ba2295-e6", "ovs_interfaceid": "07ba2295-e6c5-48cd-8fcc-0878f0dc3d06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG os_vif [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07ba2295-e6, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f58c9e65-1bee-4b04-b646-b6f9bcf650fa) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:04 user nova-compute[74721]: INFO os_vif [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:45:c5,bridge_name='br-int',has_traffic_filtering=True,id=07ba2295-e6c5-48cd-8fcc-0878f0dc3d06,network=Network(5b30b696-9410-46ad-b466-ba0740dd664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ba2295-e6')
Nov 02 23:24:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Deleting instance files /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8_del
Nov 02 23:24:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Deletion of /opt/stack/data/nova/instances/34ea2247-7f67-4ea0-b6fe-13826047d6d8_del complete
Nov 02 23:24:04 user nova-compute[74721]: INFO nova.compute.manager [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 02 23:24:04 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:24:04 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:24:05 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Took 0.49 seconds to deallocate network for instance.
Nov 02 23:24:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-58f5641a-4838-4403-890a-f9231bed7b2f req-925ff3a9-1d08-40fd-9909-1360e9b3ea21 service nova] [instance: 34ea2247-7f67-4ea0-b6fe-13826047d6d8] Received event network-vif-deleted-07ba2295-e6c5-48cd-8fcc-0878f0dc3d06 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:24:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:05 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Deleted allocations for instance 34ea2247-7f67-4ea0-b6fe-13826047d6d8
Nov 02 23:24:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-10ecb30b-e6e6-43d1-bd9f-918be376fec0 tempest-TestMinimumBasicScenario-493864842 tempest-TestMinimumBasicScenario-493864842-project-member] Lock "34ea2247-7f67-4ea0-b6fe-13826047d6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.007s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:12 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:24:12 user nova-compute[74721]: INFO nova.compute.claims [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Claim successful on node user
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:24:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.policy [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3130ca86007b4dc7b19966c8fdc2c0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d0d6d154314d36865ec3c6216bae49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:24:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Creating image(s)
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "/opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "/opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "/opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.188s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk 1073741824" returned: 0 in 0.055s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Successfully created port: b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Cannot resize image /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Ensure instance console log exists: /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Successfully updated port: b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquired lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-changed-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.compute.manager [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Refreshing instance network info cache due to event network-changed-b29f0c37-d1b0-456c-8689-60fdf108ebfd. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] Acquiring lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Updating instance_info_cache with network_info: [{"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Releasing lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Instance network_info: |[{"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] Acquired lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Refreshing network info cache for port b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Start _get_guest_xml network_info=[{"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:24:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:24:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:24:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1604418314',display_name='tempest-VolumesActionsTest-instance-1604418314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1604418314',id=44,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-udko9er3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:24:13Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=3739bc7e-c0fe-435e-883d-47e24e71941f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lazy-loading 'pci_devices' on Instance uuid 3739bc7e-c0fe-435e-883d-47e24e71941f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:24:15 user nova-compute[74721]:   <uuid>3739bc7e-c0fe-435e-883d-47e24e71941f</uuid>
Nov 02 23:24:15 user nova-compute[74721]:   <name>instance-0000002c</name>
Nov 02 23:24:15 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:24:15 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:24:15 user nova-compute[74721]:   <metadata>
Nov 02 23:24:15 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:24:15 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:name>tempest-VolumesActionsTest-instance-1604418314</nova:name>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:24:14</nova:creationTime>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:24:15 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:24:15 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:owner>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:user uuid="3130ca86007b4dc7b19966c8fdc2c0ce">tempest-VolumesActionsTest-1934758221-project-member</nova:user>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:project uuid="f0d0d6d154314d36865ec3c6216bae49">tempest-VolumesActionsTest-1934758221</nova:project>
Nov 02 23:24:15 user nova-compute[74721]:       </nova:owner>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:24:15 user nova-compute[74721]:       <nova:ports>
Nov 02 23:24:15 user nova-compute[74721]:         <nova:port uuid="b29f0c37-d1b0-456c-8689-60fdf108ebfd">
Nov 02 23:24:15 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:24:15 user nova-compute[74721]:         </nova:port>
Nov 02 23:24:15 user nova-compute[74721]:       </nova:ports>
Nov 02 23:24:15 user nova-compute[74721]:     </nova:instance>
Nov 02 23:24:15 user nova-compute[74721]:   </metadata>
Nov 02 23:24:15 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:24:15 user nova-compute[74721]:     <system>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="serial">3739bc7e-c0fe-435e-883d-47e24e71941f</entry>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="uuid">3739bc7e-c0fe-435e-883d-47e24e71941f</entry>
Nov 02 23:24:15 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:24:15 user nova-compute[74721]:     </system>
Nov 02 23:24:15 user nova-compute[74721]:   </sysinfo>
Nov 02 23:24:15 user nova-compute[74721]:   <os>
Nov 02 23:24:15 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:24:15 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:24:15 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:24:15 user nova-compute[74721]:   </os>
Nov 02 23:24:15 user nova-compute[74721]:   <features>
Nov 02 23:24:15 user nova-compute[74721]:     <acpi/>
Nov 02 23:24:15 user nova-compute[74721]:     <apic/>
Nov 02 23:24:15 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:24:15 user nova-compute[74721]:   </features>
Nov 02 23:24:15 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:24:15 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:24:15 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:24:15 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:24:15 user nova-compute[74721]:   </clock>
Nov 02 23:24:15 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:24:15 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:24:15 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:24:15 user nova-compute[74721]:   </cpu>
Nov 02 23:24:15 user nova-compute[74721]:   <devices>
Nov 02 23:24:15 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:24:15 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:24:15 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk"/>
Nov 02 23:24:15 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:24:15 user nova-compute[74721]:     </disk>
Nov 02 23:24:15 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:24:15 user nova-compute[74721]:       <mac address="fa:16:3e:ff:08:b7"/>
Nov 02 23:24:15 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:24:15 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:24:15 user nova-compute[74721]:       <target dev="tapb29f0c37-d1"/>
Nov 02 23:24:15 user nova-compute[74721]:     </interface>
Nov 02 23:24:15 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:24:15 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/console.log" append="off"/>
Nov 02 23:24:15 user nova-compute[74721]:     </serial>
Nov 02 23:24:15 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:24:15 user nova-compute[74721]:     <video>
Nov 02 23:24:15 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:24:15 user nova-compute[74721]:     </video>
Nov 02 23:24:15 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:24:15 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:24:15 user nova-compute[74721]:     </rng>
Nov 02 23:24:15 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:24:15 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:24:15 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:24:15 user nova-compute[74721]:     </memballoon>
Nov 02 23:24:15 user nova-compute[74721]:   </devices>
Nov 02 23:24:15 user nova-compute[74721]: </domain>
Nov 02 23:24:15 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1604418314',display_name='tempest-VolumesActionsTest-instance-1604418314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1604418314',id=44,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-udko9er3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:24:13Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=3739bc7e-c0fe-435e-883d-47e24e71941f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG os_vif [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e16c2811-1e19-50e0-ab88-7ead5a8969a8', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb29f0c37-d1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb29f0c37-d1, col_values=(('qos', UUID('1308169e-6b12-4141-8ff3-be8e2f56a585')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb29f0c37-d1, col_values=(('external_ids', {'iface-id': 'b29f0c37-d1b0-456c-8689-60fdf108ebfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:08:b7', 'vm-uuid': '3739bc7e-c0fe-435e-883d-47e24e71941f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:15 user nova-compute[74721]: INFO os_vif [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1')
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] No VIF found with MAC fa:16:3e:ff:08:b7, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Updated VIF entry in instance network info cache for port b29f0c37-d1b0-456c-8689-60fdf108ebfd. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Updating instance_info_cache with network_info: [{"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:24:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-7a9573b3-cd28-48a8-90d9-05e826bd4ea8 req-ecb197bf-8039-46d9-a6cf-f0ea4e5ae950 service nova] Releasing lock "refresh_cache-3739bc7e-c0fe-435e-883d-47e24e71941f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:16 user nova-compute[74721]: DEBUG nova.compute.manager [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] No waiting events found dispatching network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:24:16 user nova-compute[74721]: WARNING nova.compute.manager [req-65a19769-57a2-4b97-82db-5b24d0fe4a52 req-2eae85be-6f7c-4651-b13a-85a82a9838e3 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received unexpected event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd for instance with vm_state building and task_state spawning.
Nov 02 23:24:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:24:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Instance spawned successfully.
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:24:18 user nova-compute[74721]: INFO nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:18 user nova-compute[74721]: DEBUG nova.compute.manager [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] No waiting events found dispatching network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:24:18 user nova-compute[74721]: WARNING nova.compute.manager [req-ee5b2271-8e15-4dd6-8fe7-89f44a3984fa req-14f2bb2c-c38e-4b1d-95e2-b0a257d7c821 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received unexpected event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd for instance with vm_state building and task_state spawning.
Nov 02 23:24:18 user nova-compute[74721]: INFO nova.compute.manager [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Took 5.83 seconds to build instance.
Nov 02 23:24:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0aff6915-2a9b-47d0-9bf5-0f7e5b8873f8 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.927s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:24:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:24:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:24:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:24:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:24:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:24:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:24:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.016925811767578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance e99953a1-4e40-4106-8749-62286bdcfe96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3739bc7e-c0fe-435e-883d-47e24e71941f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:24:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-changed-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Refreshing instance network info cache due to event network-changed-2712d5f6-8cce-499c-863f-aaa8844acedd. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:25:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] Acquiring lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] Acquired lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:02 user nova-compute[74721]: DEBUG nova.network.neutron [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Refreshing network info cache for port 2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:25:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updated VIF entry in instance network info cache for port 2712d5f6-8cce-499c-863f-aaa8844acedd. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:25:03 user nova-compute[74721]: DEBUG nova.network.neutron [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updating instance_info_cache with network_info: [{"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f5a5224d-d214-4c7a-8114-702f252ea679 req-5c092f4f-d87f-45cb-96be-f9f4a94750d1 service nova] Releasing lock "refresh_cache-e99953a1-4e40-4106-8749-62286bdcfe96" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:04 user nova-compute[74721]: INFO nova.compute.manager [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Terminating instance
Nov 02 23:25:04 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-unplugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] No waiting events found dispatching network-vif-unplugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-01106fa5-6fb8-4f6c-95b9-e2351c6b4bd0 req-12ab85a8-2da6-494c-b64a-e25760db2893 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-unplugged-2712d5f6-8cce-499c-863f-aaa8844acedd for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Instance destroyed successfully.
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.objects.instance [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid e99953a1-4e40-4106-8749-62286bdcfe96 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277857812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277857812',id=43,image_ref='dcdabd3c-5897-42a6-98be-79f46239757e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMvEYHCCClbbL3um3i6zPfe0t24uyRm5O093mIt8FrIls88YlA8MtosPLQ87XuyME/ls3kvdO3GOcWO3p2FOLsXxJXtRkw+Yq+UTFtjOGzCQX8XmQJBjkmsKb0KcwnYUg==',key_name='tempest-keypair-2012929091',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-8abpcf04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1714088517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=e99953a1-4e40-4106-8749-62286bdcfe96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "2712d5f6-8cce-499c-863f-aaa8844acedd", "address": "fa:16:3e:c6:75:6d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2712d5f6-8c", "ovs_interfaceid": "2712d5f6-8cce-499c-863f-aaa8844acedd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_vif [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2712d5f6-8c, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0a9a4b4-306c-474d-a79b-eb1c8ecb540e) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:05 user nova-compute[74721]: INFO os_vif [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:75:6d,bridge_name='br-int',has_traffic_filtering=True,id=2712d5f6-8cce-499c-863f-aaa8844acedd,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2712d5f6-8c')
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSHZkIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:25:05 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ae288d-0cda-46bc-8feb-13b48806c6e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:25:05 user nova-compute[74721]: No targets found.
Nov 02 23:25:05 user nova-compute[74721]: iSNS:
Nov 02 23:25:05 user nova-compute[74721]: No targets found.
Nov 02 23:25:05 user nova-compute[74721]: STATIC:
Nov 02 23:25:05 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd
Nov 02 23:25:05 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:25:05 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:25:05 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:25:05 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:25:05 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:25:05 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3
Nov 02 23:25:05 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:25:05 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:25:05 user nova-compute[74721]: FIRMWARE:
Nov 02 23:25:05 user nova-compute[74721]: No targets found.
Nov 02 23:25:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:25:05 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:25:05 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec8b6a-0d3d-4ab2-900c-0400fe3db30c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15d6637-f56a-473b-828f-b42c099f07f9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:25:05 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:25:05 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:25:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:25:05 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:25:05 user nova-compute[74721]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd (non-flash)
Nov 02 23:25:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf0479f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd'): ({'sdf'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sdf {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18284e9-5606-4cc4-a528-a12e7889b4ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9a556-88b9-40e1-ac5b-408c8ecb7f31]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sdf {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f1bec-7b69-4169-8128-38f37cee0729]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a937c-0b49-43a6-baf6-6a2f51462383]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a75dba05', '/dev/disk/by-id/scsi-23934396364343161', '/dev/disk/by-id/scsi-1SCST_BIOa75dba05-949cd41a578d3cb6') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79106e57-ff99-4402-8439-58229964d894]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45b1f2-b937-480b-97c1-945ed60a5b38]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed9ecd7-3463-4a45-8260-74e07890a9c1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260]
Nov 02 23:25:05 user nova-compute[74721]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd, portal: 172.16.0.220,3260] successful.
Nov 02 23:25:05 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad1be4-4fe6-4779-bf88-0f4f5beceda6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (323ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:25:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Deleting instance files /opt/stack/data/nova/instances/e99953a1-4e40-4106-8749-62286bdcfe96_del
Nov 02 23:25:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Deletion of /opt/stack/data/nova/instances/e99953a1-4e40-4106-8749-62286bdcfe96_del complete
Nov 02 23:25:05 user nova-compute[74721]: INFO nova.compute.manager [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 02 23:25:05 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:25:05 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:06 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Took 0.79 seconds to deallocate network for instance.
Nov 02 23:25:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-ec30e182-5dd4-4d47-be47-7fb8ffc12526 req-557ead7d-447b-4aa0-9e65-b66867e52f96 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-deleted-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] Acquiring lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] Lock "e99953a1-4e40-4106-8749-62286bdcfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] No waiting events found dispatching network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:06 user nova-compute[74721]: WARNING nova.compute.manager [req-3fc08825-f688-4633-afb1-d35a3cd414e3 req-90ecfb43-9642-4da7-93e7-6c902997fc40 service nova] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Received unexpected event network-vif-plugged-2712d5f6-8cce-499c-863f-aaa8844acedd for instance with vm_state active and task_state deleting.
Nov 02 23:25:07 user nova-compute[74721]: INFO nova.compute.manager [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Took 0.91 seconds to detach 1 volumes for instance.
Nov 02 23:25:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: e99953a1-4e40-4106-8749-62286bdcfe96] Deleting volume: 69ff2b7e-e590-48ea-a97e-3d12c1c4a2bd {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:25:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:07 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:25:08 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:25:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:08 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance e99953a1-4e40-4106-8749-62286bdcfe96
Nov 02 23:25:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-3cb9d138-d953-46f2-a11f-fed731b0f5d6 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "e99953a1-4e40-4106-8749-62286bdcfe96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.601s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:10 user nova-compute[74721]: INFO nova.compute.manager [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Terminating instance
Nov 02 23:25:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ed2524f-efd2-460f-811c-0cb905af0d86 req-ccd971ae-0c2f-4b88-8055-025c8c936d4a service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-unplugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Instance destroyed successfully.
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid 867bc1c7-5187-4d0e-949f-cd5c11c1159e {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-580707213',display_name='tempest-ServerRescueNegativeTestJSON-server-580707213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-580707213',id=25,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-z56q9nhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:09:45Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=867bc1c7-5187-4d0e-949f-cd5c11c1159e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "address": "fa:16:3e:d0:29:54", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f24f89-d6", "ovs_interfaceid": "92f24f89-d647-4d2b-a8fe-b057760bfef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG os_vif [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92f24f89-d6, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5d5505a-91cd-47c4-981f-3331fec3cdf4) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:11 user nova-compute[74721]: INFO os_vif [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:29:54,bridge_name='br-int',has_traffic_filtering=True,id=92f24f89-d647-4d2b-a8fe-b057760bfef6,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f24f89-d6')
Nov 02 23:25:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Deleting instance files /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e_del
Nov 02 23:25:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Deletion of /opt/stack/data/nova/instances/867bc1c7-5187-4d0e-949f-cd5c11c1159e_del complete
Nov 02 23:25:11 user nova-compute[74721]: INFO nova.compute.manager [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 23:25:11 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:25:11 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:25:12 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:12 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Took 0.48 seconds to deallocate network for instance.
Nov 02 23:25:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:12 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:25:12 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:25:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:12 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Deleted allocations for instance 867bc1c7-5187-4d0e-949f-cd5c11c1159e
Nov 02 23:25:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-78fa21e5-73cf-42e8-b803-2219f63b566a tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] Acquiring lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] Lock "867bc1c7-5187-4d0e-949f-cd5c11c1159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] No waiting events found dispatching network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:13 user nova-compute[74721]: WARNING nova.compute.manager [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received unexpected event network-vif-plugged-92f24f89-d647-4d2b-a8fe-b057760bfef6 for instance with vm_state deleted and task_state None.
Nov 02 23:25:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-efab4304-e16a-40a5-abd4-48d5b36cff23 req-73260705-2d74-498f-b2cc-8ca25c397b35 service nova] [instance: 867bc1c7-5187-4d0e-949f-cd5c11c1159e] Received event network-vif-deleted-92f24f89-d647-4d2b-a8fe-b057760bfef6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:25:20 user nova-compute[74721]: INFO nova.compute.claims [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Claim successful on node user
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:25:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.policy [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b54b65445a47929910242fa7206851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0a955207b54b909bf41ecfc6198291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:25:20 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Creating image(s)
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "/opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:20 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.229s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk 1073741824" returned: 0 in 0.061s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Successfully created port: 3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Cannot resize image /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Ensure instance console log exists: /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Successfully updated port: 3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-changed-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.compute.manager [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Refreshing instance network info cache due to event network-changed-3df53505-3902-43ed-b04a-e8e2ad949548. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] Acquiring lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Instance network_info: |[{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] Acquired lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Refreshing network info cache for port 3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Start _get_guest_xml network_info=[{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:25:22 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:22 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261719188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261719188',id=45,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-ik61wdqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:25:21Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=90a900a7-735a-4be9-a265-8c26b703214f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid 90a900a7-735a-4be9-a265-8c26b703214f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:25:22 user nova-compute[74721]:   <uuid>90a900a7-735a-4be9-a265-8c26b703214f</uuid>
Nov 02 23:25:22 user nova-compute[74721]:   <name>instance-0000002d</name>
Nov 02 23:25:22 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:25:22 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:25:22 user nova-compute[74721]:   <metadata>
Nov 02 23:25:22 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:25:22 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-261719188</nova:name>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:25:22</nova:creationTime>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:25:22 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:25:22 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:owner>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:25:22 user nova-compute[74721]:       </nova:owner>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:25:22 user nova-compute[74721]:       <nova:ports>
Nov 02 23:25:22 user nova-compute[74721]:         <nova:port uuid="3df53505-3902-43ed-b04a-e8e2ad949548">
Nov 02 23:25:22 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 23:25:22 user nova-compute[74721]:         </nova:port>
Nov 02 23:25:22 user nova-compute[74721]:       </nova:ports>
Nov 02 23:25:22 user nova-compute[74721]:     </nova:instance>
Nov 02 23:25:22 user nova-compute[74721]:   </metadata>
Nov 02 23:25:22 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:25:22 user nova-compute[74721]:     <system>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="serial">90a900a7-735a-4be9-a265-8c26b703214f</entry>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="uuid">90a900a7-735a-4be9-a265-8c26b703214f</entry>
Nov 02 23:25:22 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:25:22 user nova-compute[74721]:     </system>
Nov 02 23:25:22 user nova-compute[74721]:   </sysinfo>
Nov 02 23:25:22 user nova-compute[74721]:   <os>
Nov 02 23:25:22 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:25:22 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:25:22 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:25:22 user nova-compute[74721]:   </os>
Nov 02 23:25:22 user nova-compute[74721]:   <features>
Nov 02 23:25:22 user nova-compute[74721]:     <acpi/>
Nov 02 23:25:22 user nova-compute[74721]:     <apic/>
Nov 02 23:25:22 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:25:22 user nova-compute[74721]:   </features>
Nov 02 23:25:22 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:25:22 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:25:22 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:25:22 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:25:22 user nova-compute[74721]:   </clock>
Nov 02 23:25:22 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:25:22 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:25:22 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:25:22 user nova-compute[74721]:   </cpu>
Nov 02 23:25:22 user nova-compute[74721]:   <devices>
Nov 02 23:25:22 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:25:22 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:25:22 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk"/>
Nov 02 23:25:22 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:25:22 user nova-compute[74721]:     </disk>
Nov 02 23:25:22 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:25:22 user nova-compute[74721]:       <mac address="fa:16:3e:36:94:a3"/>
Nov 02 23:25:22 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:25:22 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:25:22 user nova-compute[74721]:       <target dev="tap3df53505-39"/>
Nov 02 23:25:22 user nova-compute[74721]:     </interface>
Nov 02 23:25:22 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:25:22 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/console.log" append="off"/>
Nov 02 23:25:22 user nova-compute[74721]:     </serial>
Nov 02 23:25:22 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:25:22 user nova-compute[74721]:     <video>
Nov 02 23:25:22 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:25:22 user nova-compute[74721]:     </video>
Nov 02 23:25:22 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:25:22 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:25:22 user nova-compute[74721]:     </rng>
Nov 02 23:25:22 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:25:22 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:25:22 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:25:22 user nova-compute[74721]:     </memballoon>
Nov 02 23:25:22 user nova-compute[74721]:   </devices>
Nov 02 23:25:22 user nova-compute[74721]: </domain>
Nov 02 23:25:22 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261719188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261719188',id=45,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-ik61wdqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:25:21Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=90a900a7-735a-4be9-a265-8c26b703214f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG os_vif [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7682faab-2668-5efd-ada5-f1f73a6c597e', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3df53505-39, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3df53505-39, col_values=(('qos', UUID('e74d45a2-b24f-4bc6-b49c-5d444385d347')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3df53505-39, col_values=(('external_ids', {'iface-id': '3df53505-3902-43ed-b04a-e8e2ad949548', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:94:a3', 'vm-uuid': '90a900a7-735a-4be9-a265-8c26b703214f'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:22 user nova-compute[74721]: INFO os_vif [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39')
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:36:94:a3, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updated VIF entry in instance network info cache for port 3df53505-3902-43ed-b04a-e8e2ad949548. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9b7a29d8-4ae3-4893-9b68-1588ce174c96 req-7db88ca7-fa22-436c-bb84-952d03c80908 service nova] Releasing lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] No waiting events found dispatching network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:24 user nova-compute[74721]: WARNING nova.compute.manager [req-056da3b2-c708-428b-9c99-1e3313bdefa2 req-a18fbdbf-92af-4bc8-8532-2c851144aa46 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received unexpected event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 for instance with vm_state building and task_state spawning.
Nov 02 23:25:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:25:26 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Instance spawned successfully.
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] No waiting events found dispatching network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:26 user nova-compute[74721]: WARNING nova.compute.manager [req-f50a05ef-9d23-4a2a-bf09-29782917b8e2 req-a30a719d-20c5-4dba-8e0d-7e1bf9509bfd service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received unexpected event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 for instance with vm_state building and task_state spawning.
Nov 02 23:25:26 user nova-compute[74721]: INFO nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 02 23:25:26 user nova-compute[74721]: DEBUG nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:25:26 user nova-compute[74721]: INFO nova.compute.manager [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Took 6.08 seconds to build instance.
Nov 02 23:25:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb11168-d4ac-4172-9a16-338e51720813 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.190s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:27 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:32 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:39 user nova-compute[74721]: INFO nova.compute.manager [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Unshelving
Nov 02 23:25:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_requests' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:25:39 user nova-compute[74721]: INFO nova.compute.claims [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Claim successful on node user
Nov 02 23:25:39 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:25:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:39 user nova-compute[74721]: INFO nova.network.neutron [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating port 32bf4098-0dd2-430b-8916-ecf5c536b154 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing instance network info cache due to event network-changed-32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:25:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG nova.network.neutron [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:25:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Creating image(s)
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG nova.network.neutron [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Refreshing network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG nova.objects.base [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<2d17a40c-b25a-48b5-a23b-f06f0433c2ac> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG nova.virt.images [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] 7c2a2b25-ae81-4ba4-91cb-a96030876cb1 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.part /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updated VIF entry in instance network info cache for port 32bf4098-0dd2-430b-8916-ecf5c536b154. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG nova.network.neutron [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6551f6b2-ec76-4f3a-b546-7d41787750fd req-f97afb1d-5369-40b8-96ad-8e8fbb44a550 service nova] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.part /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.converted" returned: 0 in 0.703s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.143s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1,backing_fmt=raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1,backing_fmt=raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk 1073741824" returned: 0 in 0.047s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'migration_context' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:43 user nova-compute[74721]: DEBUG nova.objects.base [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<2d17a40c-b25a-48b5-a23b-f06f0433c2ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:25:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Rebasing disk image.
Nov 02 23:25:43 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:44 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e -F raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e -F raw /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk" returned: 0 in 2.360s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Ensure instance console log exists: /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start _get_guest_xml network_info=[{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ccfa0fe82f24170856a88010708672f0',container_format='bare',created_at=2023-11-02T23:23:46Z,direct_url=<?>,disk_format='qcow2',id=7c2a2b25-ae81-4ba4-91cb-a96030876cb1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-627122911-shelved',owner='eca645902e8740fd909d3d90bbc62b01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:23:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:25:46 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:46 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ccfa0fe82f24170856a88010708672f0',container_format='bare',created_at=2023-11-02T23:23:46Z,direct_url=<?>,disk_format='qcow2',id=7c2a2b25-ae81-4ba4-91cb-a96030876cb1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-627122911-shelved',owner='eca645902e8740fd909d3d90bbc62b01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:23:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.objects.base [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<2d17a40c-b25a-48b5-a23b-f06f0433c2ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='7c2a2b25-ae81-4ba4-91cb-a96030876cb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1744192280',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:23:50.311658',shelved_host='user',shelved_image_id='7c2a2b25-ae81-4ba4-91cb-a96030876cb1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.objects.base [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Object Instance<2d17a40c-b25a-48b5-a23b-f06f0433c2ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:25:46 user nova-compute[74721]:   <uuid>2d17a40c-b25a-48b5-a23b-f06f0433c2ac</uuid>
Nov 02 23:25:46 user nova-compute[74721]:   <name>instance-0000002a</name>
Nov 02 23:25:46 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:25:46 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:25:46 user nova-compute[74721]:   <metadata>
Nov 02 23:25:46 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:25:46 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-627122911</nova:name>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:25:46</nova:creationTime>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:25:46 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:25:46 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:owner>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:user uuid="8116c488ed184fd2ace8fdbe0845d033">tempest-AttachVolumeShelveTestJSON-110193585-project-member</nova:user>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:project uuid="eca645902e8740fd909d3d90bbc62b01">tempest-AttachVolumeShelveTestJSON-110193585</nova:project>
Nov 02 23:25:46 user nova-compute[74721]:       </nova:owner>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:root type="image" uuid="7c2a2b25-ae81-4ba4-91cb-a96030876cb1"/>
Nov 02 23:25:46 user nova-compute[74721]:       <nova:ports>
Nov 02 23:25:46 user nova-compute[74721]:         <nova:port uuid="32bf4098-0dd2-430b-8916-ecf5c536b154">
Nov 02 23:25:46 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 23:25:46 user nova-compute[74721]:         </nova:port>
Nov 02 23:25:46 user nova-compute[74721]:       </nova:ports>
Nov 02 23:25:46 user nova-compute[74721]:     </nova:instance>
Nov 02 23:25:46 user nova-compute[74721]:   </metadata>
Nov 02 23:25:46 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:25:46 user nova-compute[74721]:     <system>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="serial">2d17a40c-b25a-48b5-a23b-f06f0433c2ac</entry>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="uuid">2d17a40c-b25a-48b5-a23b-f06f0433c2ac</entry>
Nov 02 23:25:46 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:25:46 user nova-compute[74721]:     </system>
Nov 02 23:25:46 user nova-compute[74721]:   </sysinfo>
Nov 02 23:25:46 user nova-compute[74721]:   <os>
Nov 02 23:25:46 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:25:46 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:25:46 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:25:46 user nova-compute[74721]:   </os>
Nov 02 23:25:46 user nova-compute[74721]:   <features>
Nov 02 23:25:46 user nova-compute[74721]:     <acpi/>
Nov 02 23:25:46 user nova-compute[74721]:     <apic/>
Nov 02 23:25:46 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:25:46 user nova-compute[74721]:   </features>
Nov 02 23:25:46 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:25:46 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:25:46 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:25:46 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:25:46 user nova-compute[74721]:   </clock>
Nov 02 23:25:46 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:25:46 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:25:46 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:25:46 user nova-compute[74721]:   </cpu>
Nov 02 23:25:46 user nova-compute[74721]:   <devices>
Nov 02 23:25:46 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:25:46 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:25:46 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk"/>
Nov 02 23:25:46 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:25:46 user nova-compute[74721]:     </disk>
Nov 02 23:25:46 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:25:46 user nova-compute[74721]:       <mac address="fa:16:3e:fb:0f:61"/>
Nov 02 23:25:46 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:25:46 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:25:46 user nova-compute[74721]:       <target dev="tap32bf4098-0d"/>
Nov 02 23:25:46 user nova-compute[74721]:     </interface>
Nov 02 23:25:46 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:25:46 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/console.log" append="off"/>
Nov 02 23:25:46 user nova-compute[74721]:     </serial>
Nov 02 23:25:46 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:25:46 user nova-compute[74721]:     <video>
Nov 02 23:25:46 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:25:46 user nova-compute[74721]:     </video>
Nov 02 23:25:46 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:25:46 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:25:46 user nova-compute[74721]:     </rng>
Nov 02 23:25:46 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:25:46 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:25:46 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:25:46 user nova-compute[74721]:     </memballoon>
Nov 02 23:25:46 user nova-compute[74721]:   </devices>
Nov 02 23:25:46 user nova-compute[74721]: </domain>
Nov 02 23:25:46 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='7c2a2b25-ae81-4ba4-91cb-a96030876cb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1744192280',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member',shelved_at='2023-11-02T23:23:50.311658',shelved_host='user',shelved_image_id='7c2a2b25-ae81-4ba4-91cb-a96030876cb1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG os_vif [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cdf2dc0-562d-5d74-8ade-8e509b25b5f2', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32bf4098-0d, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32bf4098-0d, col_values=(('qos', UUID('9fe0a9c7-a35e-4e31-907d-d4e95b2a0f5e')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32bf4098-0d, col_values=(('external_ids', {'iface-id': '32bf4098-0dd2-430b-8916-ecf5c536b154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:0f:61', 'vm-uuid': '2d17a40c-b25a-48b5-a23b-f06f0433c2ac'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: INFO os_vif [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d')
Nov 02 23:25:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:25:46 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] No VIF found with MAC fa:16:3e:fb:0f:61, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:25:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:25:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:25:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:25:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:48 user nova-compute[74721]: WARNING nova.compute.manager [req-f2edd84e-8484-4d33-b4ce-891fe1129c83 req-bcd5f24e-13f9-42a8-933d-0625a4f9975b service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:25:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:25:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:25:50 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance spawned successfully.
Nov 02 23:25:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG nova.compute.manager [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:25:50 user nova-compute[74721]: WARNING nova.compute.manager [req-91882035-d43b-4ad0-9fb8-78cd417a75b1 req-6b1815aa-5d5d-4657-a889-d6928dbbd295 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 23:25:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:25:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a4ebf953-8e15-4cde-a209-325ddd9af02b tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.666s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:25:55 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:25:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:25:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=24.988731384277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance ed86a8bd-c846-431f-adf5-c990136d5e85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3739bc7e-c0fe-435e-883d-47e24e71941f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:25:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:01 user nova-compute[74721]: INFO nova.compute.manager [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Terminating instance
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.compute.manager [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.compute.manager [req-20cf8a2e-7522-4359-90ec-77199044e51c req-063cb87f-6b6e-475d-8c87-8b0261b25cfb service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-unplugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Instance destroyed successfully.
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.objects.instance [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lazy-loading 'resources' on Instance uuid ed86a8bd-c846-431f-adf5-c990136d5e85 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2029541802',display_name='tempest-ServerRescueNegativeTestJSON-server-2029541802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2029541802',id=23,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:12:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dc5e65b042947ed8f88d0a0722d2f78',ramdisk_id='',reservation_id='r-4vh1kk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-544702659',owner_user_name='tempest-ServerRescueNegativeTestJSON-544702659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:14:36Z,user_data=None,user_id='ee89915190bc4dcaafc152b0767d70a1',uuid=ed86a8bd-c846-431f-adf5-c990136d5e85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converting VIF {"id": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "address": "fa:16:3e:8b:6f:d1", "network": {"id": "bbc72a50-6231-4f59-9c3b-27406d71e55f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1138103729-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dc5e65b042947ed8f88d0a0722d2f78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c2b78d-27", "ovs_interfaceid": "a9c2b78d-27f7-43b5-9a40-7330ef5cf205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG os_vif [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9c2b78d-27, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1153ab32-74e7-4aa2-993a-9c15eda008d3) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:02 user nova-compute[74721]: INFO os_vif [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:6f:d1,bridge_name='br-int',has_traffic_filtering=True,id=a9c2b78d-27f7-43b5-9a40-7330ef5cf205,network=Network(bbc72a50-6231-4f59-9c3b-27406d71e55f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c2b78d-27')
Nov 02 23:26:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Deleting instance files /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85_del
Nov 02 23:26:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Deletion of /opt/stack/data/nova/instances/ed86a8bd-c846-431f-adf5-c990136d5e85_del complete
Nov 02 23:26:02 user nova-compute[74721]: INFO nova.compute.manager [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 02 23:26:02 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:02 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Took 0.52 seconds to deallocate network for instance.
Nov 02 23:26:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:26:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:02 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Deleted allocations for instance ed86a8bd-c846-431f-adf5-c990136d5e85
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-e3c0adfd-ae9d-4a59-ab6f-a7b270c6a49f tempest-ServerRescueNegativeTestJSON-544702659 tempest-ServerRescueNegativeTestJSON-544702659-project-member] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:03 user nova-compute[74721]: INFO nova.compute.manager [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Terminating instance
Nov 02 23:26:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] Acquiring lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] Lock "ed86a8bd-c846-431f-adf5-c990136d5e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] No waiting events found dispatching network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:03 user nova-compute[74721]: WARNING nova.compute.manager [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received unexpected event network-vif-plugged-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 for instance with vm_state deleted and task_state None.
Nov 02 23:26:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-bd90bee6-0906-4bc6-8e8c-c01dbaa7ef12 req-e87bc2de-3281-4cae-aa53-2d70f6dbf3d4 service nova] [instance: ed86a8bd-c846-431f-adf5-c990136d5e85] Received event network-vif-deleted-a9c2b78d-27f7-43b5-9a40-7330ef5cf205 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-unplugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] No waiting events found dispatching network-vif-unplugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-8df66521-208c-44ce-94f5-6f54e3219332 req-2a0c3418-6ba7-47f1-83ca-ed5df258168a service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-unplugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:26:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Instance destroyed successfully.
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lazy-loading 'resources' on Instance uuid 3739bc7e-c0fe-435e-883d-47e24e71941f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1604418314',display_name='tempest-VolumesActionsTest-instance-1604418314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1604418314',id=44,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-udko9er3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:24:19Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=3739bc7e-c0fe-435e-883d-47e24e71941f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "address": "fa:16:3e:ff:08:b7", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29f0c37-d1", "ovs_interfaceid": "b29f0c37-d1b0-456c-8689-60fdf108ebfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG os_vif [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb29f0c37-d1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1308169e-6b12-4141-8ff3-be8e2f56a585) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:04 user nova-compute[74721]: INFO os_vif [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:08:b7,bridge_name='br-int',has_traffic_filtering=True,id=b29f0c37-d1b0-456c-8689-60fdf108ebfd,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29f0c37-d1')
Nov 02 23:26:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Deleting instance files /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f_del
Nov 02 23:26:04 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Deletion of /opt/stack/data/nova/instances/3739bc7e-c0fe-435e-883d-47e24e71941f_del complete
Nov 02 23:26:04 user nova-compute[74721]: INFO nova.compute.manager [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 23:26:04 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:26:04 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:05 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Took 0.61 seconds to deallocate network for instance.
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:05 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Deleted allocations for instance 3739bc7e-c0fe-435e-883d-47e24e71941f
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c7db03f0-8710-480e-9974-9eaa7f14f32d tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-a819ce7e-6cbf-42a3-8d4f-c3a32a6ceff0 req-a80fd4ff-f0a4-47c0-ab18-8d557a3946a7 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-deleted-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:05 user nova-compute[74721]: INFO nova.compute.manager [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Terminating instance
Nov 02 23:26:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] Acquiring lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] Lock "3739bc7e-c0fe-435e-883d-47e24e71941f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] No waiting events found dispatching network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:06 user nova-compute[74721]: WARNING nova.compute.manager [req-a629d873-0921-4580-84dd-1822733ac8c3 req-45f6ca07-e76c-41f2-8e19-18dbbc25fce8 service nova] [instance: 3739bc7e-c0fe-435e-883d-47e24e71941f] Received unexpected event network-vif-plugged-b29f0c37-d1b0-456c-8689-60fdf108ebfd for instance with vm_state deleted and task_state None.
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Instance destroyed successfully.
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1859595536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1859595536',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5JgMri7zoT37QPEZ9Ep5w7T4eXAgf5aRXJlKMmP+vEDQqPwiPKazue0iwQz8scmNcuMrFUidvuJAObE7noDfD9HlmBUwA89RLelJiLiF2sPScrWPMuJqGT+cXGQM/m9Q==',key_name='tempest-keypair-749712009',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pn3gwn0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "address": "fa:16:3e:f4:1a:11", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aa02d5-00", "ovs_interfaceid": "48aa02d5-0025-4eb0-82e0-b7660e4ffd11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_vif [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48aa02d5-00, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5f0ede0-0ad1-40f4-8364-c2bb99537b64) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: INFO os_vif [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=48aa02d5-0025-4eb0-82e0-b7660e4ffd11,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aa02d5-00')
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwaCTBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:26:06 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[39287b9f-36c2-487e-beae-38ee747367aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:26:06 user nova-compute[74721]: No targets found.
Nov 02 23:26:06 user nova-compute[74721]: iSNS:
Nov 02 23:26:06 user nova-compute[74721]: No targets found.
Nov 02 23:26:06 user nova-compute[74721]: STATIC:
Nov 02 23:26:06 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:26:06 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:26:06 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:26:06 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3
Nov 02 23:26:06 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:26:06 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:26:06 user nova-compute[74721]: FIRMWARE:
Nov 02 23:26:06 user nova-compute[74721]: No targets found.
Nov 02 23:26:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:26:06 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:26:06 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a9b12-a976-46b3-8dd2-888761563e01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1ffa8-e610-4215-8c59-f0d68f095625]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:26:06 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:26:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:26:06 user nova-compute[74721]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 (non-flash)
Nov 02 23:26:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf3c255f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1cbdbb-4f9c-48b5-ab1f-73bef5709cec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[961a5874-4d19-4393-b6ad-ad5e168055e1]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c33d040-9d11-4ed3-8d46-de5ced71d777]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb14aee-8b69-4bb2-9675-5782b0795f61]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23630643265613734',) {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:26:06 user nova-compute[74721]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23630643265613734
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[771514e3-16f5-4609-a555-8cd24a65e490]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95e890-2870-481d-acb0-2e75f6883e97]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9b55e-0129-4b83-99a1-e581d2b2f893]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260]
Nov 02 23:26:06 user nova-compute[74721]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3, portal: 172.16.0.220,3260] successful.
Nov 02 23:26:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10196e6e-d89b-49a5-84f5-4a73e97301b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[031772e6-6517-470c-ac65-6ed09ce65759]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (324ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:26:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:26:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Deleting instance files /opt/stack/data/nova/instances/1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5_del
Nov 02 23:26:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Deletion of /opt/stack/data/nova/instances/1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5_del complete
Nov 02 23:26:07 user nova-compute[74721]: INFO nova.compute.manager [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 02 23:26:07 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:26:07 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:26:07 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:26:07 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:07 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Took 0.68 seconds to deallocate network for instance.
Nov 02 23:26:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-a2326d0d-4cdf-4c38-bc7e-e3c1fbd17e34 req-bdda2ac8-8b3c-4d04-a015-c2cc325478af service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-deleted-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-unplugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] No waiting events found dispatching network-vif-unplugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-unplugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Acquiring lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] No waiting events found dispatching network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:26:08 user nova-compute[74721]: WARNING nova.compute.manager [req-fcde8208-6022-417c-87f0-3d7bd2cffca3 req-a74524bc-0d4b-4a1e-b2cd-8aa21dc578e4 service nova] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Received unexpected event network-vif-plugged-48aa02d5-0025-4eb0-82e0-b7660e4ffd11 for instance with vm_state active and task_state deleting.
Nov 02 23:26:08 user nova-compute[74721]: INFO nova.compute.manager [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Took 0.85 seconds to detach 1 volumes for instance.
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.manager [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5] Deleting volume: 10196e6e-d89b-49a5-84f5-4a73e97301b3 {{(pid=74721) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:26:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:08 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance 1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5
Nov 02 23:26:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f62-c4d0-4119-a907-d3141c735954 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "1fe2f8e2-71d0-4aa5-b9be-7aa0bcab0be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:26:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:48 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [{"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-2d17a40c-b25a-48b5-a23b-f06f0433c2ac" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:26:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:26:55 user nova-compute[74721]: INFO nova.compute.claims [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Claim successful on node user
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:26:55 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.394s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:26:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.policy [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3130ca86007b4dc7b19966c8fdc2c0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0d0d6d154314d36865ec3c6216bae49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:26:56 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Creating image(s)
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "/opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "/opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "/opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk 1073741824" returned: 0 in 0.051s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:56 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Successfully created port: 15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Cannot resize image /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Ensure instance console log exists: /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:26:57 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Successfully updated port: 15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:26:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:26:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.034923553466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-changed-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.manager [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Refreshing instance network info cache due to event network-changed-15c2bf17-0db1-4151-ae86-8a3527e25201. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] Acquiring lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] Acquired lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Refreshing network info cache for port 15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1ebb6524-74c8-421b-a794-39ce7c3545ce req-c52239ee-e3e0-4f61-8709-c09a0a92ace0 service nova] Releasing lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquired lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.neutron [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Updating instance_info_cache with network_info: [{"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Releasing lock "refresh_cache-29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance network_info: |[{"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Start _get_guest_xml network_info=[{"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:26:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:26:58 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209426409',display_name='tempest-VolumesActionsTest-instance-209426409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209426409',id=46,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-1pqy1stk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:26:56Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lazy-loading 'pci_devices' on Instance uuid 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:26:58 user nova-compute[74721]:   <uuid>29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea</uuid>
Nov 02 23:26:58 user nova-compute[74721]:   <name>instance-0000002e</name>
Nov 02 23:26:58 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:26:58 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:26:58 user nova-compute[74721]:   <metadata>
Nov 02 23:26:58 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:26:58 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:name>tempest-VolumesActionsTest-instance-209426409</nova:name>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:26:58</nova:creationTime>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:26:58 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:26:58 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:owner>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:user uuid="3130ca86007b4dc7b19966c8fdc2c0ce">tempest-VolumesActionsTest-1934758221-project-member</nova:user>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:project uuid="f0d0d6d154314d36865ec3c6216bae49">tempest-VolumesActionsTest-1934758221</nova:project>
Nov 02 23:26:58 user nova-compute[74721]:       </nova:owner>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:26:58 user nova-compute[74721]:       <nova:ports>
Nov 02 23:26:58 user nova-compute[74721]:         <nova:port uuid="15c2bf17-0db1-4151-ae86-8a3527e25201">
Nov 02 23:26:58 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 23:26:58 user nova-compute[74721]:         </nova:port>
Nov 02 23:26:58 user nova-compute[74721]:       </nova:ports>
Nov 02 23:26:58 user nova-compute[74721]:     </nova:instance>
Nov 02 23:26:58 user nova-compute[74721]:   </metadata>
Nov 02 23:26:58 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:26:58 user nova-compute[74721]:     <system>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="serial">29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea</entry>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="uuid">29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea</entry>
Nov 02 23:26:58 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:26:58 user nova-compute[74721]:     </system>
Nov 02 23:26:58 user nova-compute[74721]:   </sysinfo>
Nov 02 23:26:58 user nova-compute[74721]:   <os>
Nov 02 23:26:58 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:26:58 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:26:58 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:26:58 user nova-compute[74721]:   </os>
Nov 02 23:26:58 user nova-compute[74721]:   <features>
Nov 02 23:26:58 user nova-compute[74721]:     <acpi/>
Nov 02 23:26:58 user nova-compute[74721]:     <apic/>
Nov 02 23:26:58 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:26:58 user nova-compute[74721]:   </features>
Nov 02 23:26:58 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:26:58 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:26:58 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:26:58 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:26:58 user nova-compute[74721]:   </clock>
Nov 02 23:26:58 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:26:58 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:26:58 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:26:58 user nova-compute[74721]:   </cpu>
Nov 02 23:26:58 user nova-compute[74721]:   <devices>
Nov 02 23:26:58 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:26:58 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:26:58 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk"/>
Nov 02 23:26:58 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:26:58 user nova-compute[74721]:     </disk>
Nov 02 23:26:58 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:26:58 user nova-compute[74721]:       <mac address="fa:16:3e:0e:b4:d4"/>
Nov 02 23:26:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:26:58 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:26:58 user nova-compute[74721]:       <target dev="tap15c2bf17-0d"/>
Nov 02 23:26:58 user nova-compute[74721]:     </interface>
Nov 02 23:26:58 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:26:58 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/console.log" append="off"/>
Nov 02 23:26:58 user nova-compute[74721]:     </serial>
Nov 02 23:26:58 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:26:58 user nova-compute[74721]:     <video>
Nov 02 23:26:58 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:26:58 user nova-compute[74721]:     </video>
Nov 02 23:26:58 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:26:58 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:26:58 user nova-compute[74721]:     </rng>
Nov 02 23:26:58 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:26:58 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:26:58 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:26:58 user nova-compute[74721]:     </memballoon>
Nov 02 23:26:58 user nova-compute[74721]:   </devices>
Nov 02 23:26:58 user nova-compute[74721]: </domain>
Nov 02 23:26:58 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209426409',display_name='tempest-VolumesActionsTest-instance-209426409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209426409',id=46,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-1pqy1stk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:26:56Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG os_vif [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3ed5436-98b5-54e0-b74c-1a33de3d22b1', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15c2bf17-0d, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15c2bf17-0d, col_values=(('qos', UUID('b8841c55-11a2-4ae6-bd11-151d606fb997')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15c2bf17-0d, col_values=(('external_ids', {'iface-id': '15c2bf17-0db1-4151-ae86-8a3527e25201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:b4:d4', 'vm-uuid': '29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:26:58 user nova-compute[74721]: INFO os_vif [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d')
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:26:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] No VIF found with MAC fa:16:3e:0e:b4:d4, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:26:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:26:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG nova.compute.manager [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] No waiting events found dispatching network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:00 user nova-compute[74721]: WARNING nova.compute.manager [req-056e92a0-b8b8-45df-8948-049764b9c587 req-f74bb591-e1d4-49e9-94f1-eebc2f5998ce service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received unexpected event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 for instance with vm_state building and task_state spawning.
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:27:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance spawned successfully.
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:02 user nova-compute[74721]: INFO nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:27:02 user nova-compute[74721]: INFO nova.compute.manager [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Took 6.83 seconds to build instance.
Nov 02 23:27:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-16617761-b629-4155-8876-6d6d937a8027 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.924s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] No waiting events found dispatching network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:02 user nova-compute[74721]: WARNING nova.compute.manager [req-527a41a0-8f99-44b5-8c31-19a546e9b273 req-abee438f-1cd0-4404-add4-0927b2bc9f0d service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received unexpected event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 for instance with vm_state active and task_state None.
Nov 02 23:27:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:05 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:27:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:27:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:09 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:27:11 user nova-compute[74721]: INFO nova.compute.manager [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] instance snapshotting
Nov 02 23:27:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Beginning live snapshot process
Nov 02 23:27:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.168s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f.delta 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:12 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f.delta 1073741824" returned: 0 in 0.050s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:12 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 23:27:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:27:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:27:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 23:27:13 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:27:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f.delta /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f.delta /opt/stack/data/nova/instances/snapshots/tmpxar2hmou/6a767ce92616409c8c6e4c3c09bef30f" returned: 0 in 0.481s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Snapshot extracted, beginning image upload
Nov 02 23:27:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Snapshot image upload complete
Nov 02 23:27:16 user nova-compute[74721]: INFO nova.compute.manager [None req-802a664a-41ca-4320-ac50-63482571ec1a tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Took 5.29 seconds to snapshot the instance on the hypervisor.
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:27:18 user nova-compute[74721]: INFO nova.compute.claims [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Claim successful on node user
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:27:18 user nova-compute[74721]: INFO nova.virt.block_device [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Booting with volume 776c1c64-888f-4081-996f-6562beb32c53 at /dev/vda
Nov 02 23:27:18 user nova-compute[74721]: DEBUG nova.policy [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG os_brick.utils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[af339dc1-bfc1-4aa4-98d5-a29852105e43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c389c923-68ec-4948-a193-980112f7dd28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b5291-80c3-407d-b364-5dc9b0ebb020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb0b9a-4f29-4839-97ee-7d9767101e08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:27:19 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:27:19 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae77b4-1d95-478f-a103-ebfddaa23260]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG os_brick.utils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updating existing volume attachment record: bb6cb5eb-e25c-4f3f-9510-0c18d5b4cbda {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:27:19 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Successfully created port: 5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Successfully updated port: 5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-changed-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Refreshing instance network info cache due to event network-changed-5e57adf8-906c-4f79-ac85-f9370cd47157. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] Acquiring lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updating instance_info_cache with network_info: [{"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Instance network_info: |[{"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] Acquired lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:27:20 user nova-compute[74721]: DEBUG nova.network.neutron [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Refreshing network info cache for port 5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:27:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updated VIF entry in instance network info cache for port 5e57adf8-906c-4f79-ac85-f9370cd47157. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:27:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updating instance_info_cache with network_info: [{"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ab99518e-42fd-446f-b6de-0c80b92b32b1 req-de6e80e7-64ea-4c68-9239-3b770fd29e03 service nova] Releasing lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:27:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:29 user nova-compute[74721]: INFO nova.compute.manager [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Terminating instance
Nov 02 23:27:29 user nova-compute[74721]: DEBUG nova.compute.manager [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:29 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8e03734-415f-4678-ad64-fd6fb3f1c90e req-45a131bf-cd9f-4988-ba70-19395e176a36 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-unplugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:27:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Instance destroyed successfully.
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.objects.instance [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lazy-loading 'resources' on Instance uuid 2d17a40c-b25a-48b5-a23b-f06f0433c2ac {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T23:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-627122911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-627122911',id=42,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5ecrvhsqkqbRPidyokzNG80X82YjyUzwRidl4+95lsQ13nJXFzndK70XKYP9Km/QMrfwDO5bxIyEmtMzGHY7Ue1/B7zaGu9nyMBmLl7MLm5SItCZJx9Amp3tF5N9aQOg==',key_name='tempest-keypair-1744192280',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:25:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eca645902e8740fd909d3d90bbc62b01',ramdisk_id='',reservation_id='r-w9lrdf3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-110193585',owner_user_name='tempest-AttachVolumeShelveTestJSON-110193585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8116c488ed184fd2ace8fdbe0845d033',uuid=2d17a40c-b25a-48b5-a23b-f06f0433c2ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converting VIF {"id": "32bf4098-0dd2-430b-8916-ecf5c536b154", "address": "fa:16:3e:fb:0f:61", "network": {"id": "862d1151-1ba7-4800-a9f9-0eee5c07c378", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1116045754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eca645902e8740fd909d3d90bbc62b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32bf4098-0d", "ovs_interfaceid": "32bf4098-0dd2-430b-8916-ecf5c536b154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG os_vif [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32bf4098-0d, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fe0a9c7-a35e-4e31-907d-d4e95b2a0f5e) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:30 user nova-compute[74721]: INFO os_vif [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0f:61,bridge_name='br-int',has_traffic_filtering=True,id=32bf4098-0dd2-430b-8916-ecf5c536b154,network=Network(862d1151-1ba7-4800-a9f9-0eee5c07c378),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32bf4098-0d')
Nov 02 23:27:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Deleting instance files /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac_del
Nov 02 23:27:30 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Deletion of /opt/stack/data/nova/instances/2d17a40c-b25a-48b5-a23b-f06f0433c2ac_del complete
Nov 02 23:27:30 user nova-compute[74721]: INFO nova.compute.manager [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 23:27:30 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:30 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Took 0.71 seconds to deallocate network for instance.
Nov 02 23:27:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-03c6443c-5df1-4653-b290-58f55a84d42c req-f43580dd-7973-48cb-9b9d-ed110fc087d3 service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-deleted-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:31 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Deleted allocations for instance 2d17a40c-b25a-48b5-a23b-f06f0433c2ac
Nov 02 23:27:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-caa844b3-2e32-4af6-8948-1c9ed2d77933 tempest-AttachVolumeShelveTestJSON-110193585 tempest-AttachVolumeShelveTestJSON-110193585-project-member] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] Acquiring lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] Lock "2d17a40c-b25a-48b5-a23b-f06f0433c2ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:31 user nova-compute[74721]: DEBUG nova.compute.manager [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] No waiting events found dispatching network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:31 user nova-compute[74721]: WARNING nova.compute.manager [req-af93b4e8-c83f-460d-abb5-f29cefe6183b req-e2bf520d-1be5-491b-9cb1-c845a29aa2fa service nova] [instance: 2d17a40c-b25a-48b5-a23b-f06f0433c2ac] Received unexpected event network-vif-plugged-32bf4098-0dd2-430b-8916-ecf5c536b154 for instance with vm_state deleted and task_state None.
Nov 02 23:27:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Skipping network cache update for instance because it is Building. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:27:47 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:27:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:27:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:27:49 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Creating image(s)
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Ensure instance console log exists: /opt/stack/data/nova/instances/6720caac-bc25-4335-9cc3-6916e1c59003/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Start _get_guest_xml network_info=[{"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'bb6cb5eb-e25c-4f3f-9510-0c18d5b4cbda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6720caac-bc25-4335-9cc3-6916e1c59003', 'attached_at': '', 'detached_at': '', 'volume_id': '776c1c64-888f-4081-996f-6562beb32c53', 'serial': '776c1c64-888f-4081-996f-6562beb32c53'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:27:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:49 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:27:49 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:27:49 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:27:49 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a775d-f132-4a36-a495-9365f775b3b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:27:49 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b53b18-58d3-4032-8b0c-034d0ecf9137]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53] added
Nov 02 23:27:49 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d449f-b0ac-440a-a8f0-a87e21d45500]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ce08c-dbdd-4d82-ab8e-3d9dd8f8baf7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhYaUQHk {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhYaUQHk" returned: 0 in 0.028s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b590a0-c066-4c97-92d8-66250af04a40]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhYaUQHk'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5946455-4e03-4577-8f0f-5b44537a121d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:49 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703c132-fbf1-4eba-8fc4-ad375c9a0d67]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f246d-cf42-43ec-a778-4212cdb7b84d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]
Nov 02 23:27:50 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.
Nov 02 23:27:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddc29e-ad36-4e76-ba77-1e5411883ca5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a36d3-e5af-44d0-9323-3bbc418a5baa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:27:50 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3a628-db4f-4ffe-b278-193fe870fec0]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:27:51 user nova-compute[74721]: INFO nova.compute.claims [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Claim successful on node user
Nov 02 23:27:51 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23736613932313965', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613932313965', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-855479161',display_name='tempest-TestVolumeBootPattern-server-855479161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-855479161',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-clllgigk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:27:19Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=6720caac-bc25-4335-9cc3-6916e1c59003,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid 6720caac-bc25-4335-9cc3-6916e1c59003 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:27:51 user nova-compute[74721]:   <uuid>6720caac-bc25-4335-9cc3-6916e1c59003</uuid>
Nov 02 23:27:51 user nova-compute[74721]:   <name>instance-0000002f</name>
Nov 02 23:27:51 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:27:51 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:27:51 user nova-compute[74721]:   <metadata>
Nov 02 23:27:51 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:27:51 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:27:51 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-server-855479161</nova:name>
Nov 02 23:27:51 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:27:49</nova:creationTime>
Nov 02 23:27:51 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:27:51 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:27:51 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:27:51 user nova-compute[74721]:       <nova:owner>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:27:51 user nova-compute[74721]:       </nova:owner>
Nov 02 23:27:51 user nova-compute[74721]:       <nova:ports>
Nov 02 23:27:51 user nova-compute[74721]:         <nova:port uuid="5e57adf8-906c-4f79-ac85-f9370cd47157">
Nov 02 23:27:51 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 23:27:51 user nova-compute[74721]:         </nova:port>
Nov 02 23:27:51 user nova-compute[74721]:       </nova:ports>
Nov 02 23:27:51 user nova-compute[74721]:     </nova:instance>
Nov 02 23:27:51 user nova-compute[74721]:   </metadata>
Nov 02 23:27:51 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:27:51 user nova-compute[74721]:     <system>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="serial">6720caac-bc25-4335-9cc3-6916e1c59003</entry>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="uuid">6720caac-bc25-4335-9cc3-6916e1c59003</entry>
Nov 02 23:27:51 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:27:51 user nova-compute[74721]:     </system>
Nov 02 23:27:51 user nova-compute[74721]:   </sysinfo>
Nov 02 23:27:51 user nova-compute[74721]:   <os>
Nov 02 23:27:51 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:27:51 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:27:51 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:27:51 user nova-compute[74721]:   </os>
Nov 02 23:27:51 user nova-compute[74721]:   <features>
Nov 02 23:27:51 user nova-compute[74721]:     <acpi/>
Nov 02 23:27:51 user nova-compute[74721]:     <apic/>
Nov 02 23:27:51 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:27:51 user nova-compute[74721]:   </features>
Nov 02 23:27:51 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:27:51 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:27:51 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:27:51 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:27:51 user nova-compute[74721]:   </clock>
Nov 02 23:27:51 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:27:51 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:27:51 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:27:51 user nova-compute[74721]:   </cpu>
Nov 02 23:27:51 user nova-compute[74721]:   <devices>
Nov 02 23:27:51 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:27:51 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:27:51 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:27:51 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:27:51 user nova-compute[74721]:       <serial>776c1c64-888f-4081-996f-6562beb32c53</serial>
Nov 02 23:27:51 user nova-compute[74721]:     </disk>
Nov 02 23:27:51 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:27:51 user nova-compute[74721]:       <mac address="fa:16:3e:65:f3:0d"/>
Nov 02 23:27:51 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:27:51 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:27:51 user nova-compute[74721]:       <target dev="tap5e57adf8-90"/>
Nov 02 23:27:51 user nova-compute[74721]:     </interface>
Nov 02 23:27:51 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:27:51 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/6720caac-bc25-4335-9cc3-6916e1c59003/console.log" append="off"/>
Nov 02 23:27:51 user nova-compute[74721]:     </serial>
Nov 02 23:27:51 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:27:51 user nova-compute[74721]:     <video>
Nov 02 23:27:51 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:27:51 user nova-compute[74721]:     </video>
Nov 02 23:27:51 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:27:51 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:27:51 user nova-compute[74721]:     </rng>
Nov 02 23:27:51 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:27:51 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:27:51 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:27:51 user nova-compute[74721]:     </memballoon>
Nov 02 23:27:51 user nova-compute[74721]:   </devices>
Nov 02 23:27:51 user nova-compute[74721]: </domain>
Nov 02 23:27:51 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-855479161',display_name='tempest-TestVolumeBootPattern-server-855479161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-855479161',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-clllgigk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:27:19Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=6720caac-bc25-4335-9cc3-6916e1c59003,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG os_vif [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ec76ec1-aeee-5cb1-b530-8305f34de501', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e57adf8-90, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e57adf8-90, col_values=(('qos', UUID('f7328c8f-5d2b-4769-9553-38a7f282c3b1')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e57adf8-90, col_values=(('external_ids', {'iface-id': '5e57adf8-906c-4f79-ac85-f9370cd47157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:f3:0d', 'vm-uuid': '6720caac-bc25-4335-9cc3-6916e1c59003'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: INFO os_vif [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90')
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:65:f3:0d, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:27:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.policy [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '736f23e5c24647bbb029d29a6f48cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b013767d15ba4080b709cfd55431494b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:27:51 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Creating image(s)
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "/opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "/opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "/opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "04bb4d08328a96c91fe87ae379bb4017af42524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:51 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk 1073741824" returned: 0 in 0.056s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "04bb4d08328a96c91fe87ae379bb4017af42524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Successfully created port: 34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk. size=1073741824 {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG nova.virt.disk.api [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Cannot resize image /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk to a smaller size. {{(pid=74721) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Ensure instance console log exists: /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] No waiting events found dispatching network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:53 user nova-compute[74721]: WARNING nova.compute.manager [req-69d515db-b3f0-4b6a-8e26-ca44b83f8472 req-ca8340e2-2459-4b32-adac-70ab4249a0ff service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received unexpected event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 for instance with vm_state building and task_state spawning.
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Successfully updated port: 34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquired lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Releasing lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Instance network_info: |[{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Start _get_guest_xml network_info=[{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'bf81f74d-ac5b-4b08-8444-661e551c1f11'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:27:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:53 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-718678891',display_name='tempest-TestStampPattern-server-718678891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718678891',id=48,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-07w7jwuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:27:52Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=814f0703-fa5a-4a44-8dfb-91a9b9dcf091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'pci_devices' on Instance uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:27:53 user nova-compute[74721]:   <uuid>814f0703-fa5a-4a44-8dfb-91a9b9dcf091</uuid>
Nov 02 23:27:53 user nova-compute[74721]:   <name>instance-00000030</name>
Nov 02 23:27:53 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:27:53 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:27:53 user nova-compute[74721]:   <metadata>
Nov 02 23:27:53 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:27:53 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:name>tempest-TestStampPattern-server-718678891</nova:name>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:27:53</nova:creationTime>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:27:53 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:27:53 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:owner>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:user uuid="736f23e5c24647bbb029d29a6f48cf38">tempest-TestStampPattern-573014398-project-member</nova:user>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:project uuid="b013767d15ba4080b709cfd55431494b">tempest-TestStampPattern-573014398</nova:project>
Nov 02 23:27:53 user nova-compute[74721]:       </nova:owner>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:27:53 user nova-compute[74721]:       <nova:ports>
Nov 02 23:27:53 user nova-compute[74721]:         <nova:port uuid="34f13e7b-2448-4acf-80ba-5973f6a9d877">
Nov 02 23:27:53 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:27:53 user nova-compute[74721]:         </nova:port>
Nov 02 23:27:53 user nova-compute[74721]:       </nova:ports>
Nov 02 23:27:53 user nova-compute[74721]:     </nova:instance>
Nov 02 23:27:53 user nova-compute[74721]:   </metadata>
Nov 02 23:27:53 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:27:53 user nova-compute[74721]:     <system>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="serial">814f0703-fa5a-4a44-8dfb-91a9b9dcf091</entry>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="uuid">814f0703-fa5a-4a44-8dfb-91a9b9dcf091</entry>
Nov 02 23:27:53 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:27:53 user nova-compute[74721]:     </system>
Nov 02 23:27:53 user nova-compute[74721]:   </sysinfo>
Nov 02 23:27:53 user nova-compute[74721]:   <os>
Nov 02 23:27:53 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:27:53 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:27:53 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:27:53 user nova-compute[74721]:   </os>
Nov 02 23:27:53 user nova-compute[74721]:   <features>
Nov 02 23:27:53 user nova-compute[74721]:     <acpi/>
Nov 02 23:27:53 user nova-compute[74721]:     <apic/>
Nov 02 23:27:53 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:27:53 user nova-compute[74721]:   </features>
Nov 02 23:27:53 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:27:53 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:27:53 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:27:53 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:27:53 user nova-compute[74721]:   </clock>
Nov 02 23:27:53 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:27:53 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:27:53 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:27:53 user nova-compute[74721]:   </cpu>
Nov 02 23:27:53 user nova-compute[74721]:   <devices>
Nov 02 23:27:53 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:27:53 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:27:53 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk"/>
Nov 02 23:27:53 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:27:53 user nova-compute[74721]:     </disk>
Nov 02 23:27:53 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:27:53 user nova-compute[74721]:       <mac address="fa:16:3e:a8:55:77"/>
Nov 02 23:27:53 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:27:53 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:27:53 user nova-compute[74721]:       <target dev="tap34f13e7b-24"/>
Nov 02 23:27:53 user nova-compute[74721]:     </interface>
Nov 02 23:27:53 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:27:53 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/console.log" append="off"/>
Nov 02 23:27:53 user nova-compute[74721]:     </serial>
Nov 02 23:27:53 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:27:53 user nova-compute[74721]:     <video>
Nov 02 23:27:53 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:27:53 user nova-compute[74721]:     </video>
Nov 02 23:27:53 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:27:53 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:27:53 user nova-compute[74721]:     </rng>
Nov 02 23:27:53 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:27:53 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:27:53 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:27:53 user nova-compute[74721]:     </memballoon>
Nov 02 23:27:53 user nova-compute[74721]:   </devices>
Nov 02 23:27:53 user nova-compute[74721]: </domain>
Nov 02 23:27:53 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-718678891',display_name='tempest-TestStampPattern-server-718678891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718678891',id=48,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-07w7jwuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:27:52Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=814f0703-fa5a-4a44-8dfb-91a9b9dcf091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG os_vif [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7747768e-813e-5b16-a7ba-9dd2e2fa2aff', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f13e7b-24, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34f13e7b-24, col_values=(('qos', UUID('bb0634ef-e25b-4b45-9a61-87c90fffe5ff')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34f13e7b-24, col_values=(('external_ids', {'iface-id': '34f13e7b-2448-4acf-80ba-5973f6a9d877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:55:77', 'vm-uuid': '814f0703-fa5a-4a44-8dfb-91a9b9dcf091'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:53 user nova-compute[74721]: INFO os_vif [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24')
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:27:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No VIF found with MAC fa:16:3e:a8:55:77, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:27:54 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Instance spawned successfully.
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:54 user nova-compute[74721]: INFO nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 02 23:27:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:27:54 user nova-compute[74721]: INFO nova.compute.manager [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Took 36.59 seconds to build instance.
Nov 02 23:27:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6efdd827-e2b7-4f79-ad0d-44bfb77abfb7 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.710s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing instance network info cache due to event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Acquiring lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Acquired lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] No waiting events found dispatching network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:55 user nova-compute[74721]: WARNING nova.compute.manager [req-6bbcc9e2-d675-4815-80fa-84a2958b4d9d req-3d2bb909-8d4c-407e-94e3-468e5272b444 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received unexpected event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 for instance with vm_state building and task_state spawning.
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updated VIF entry in instance network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Releasing lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] No waiting events found dispatching network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:55 user nova-compute[74721]: WARNING nova.compute.manager [req-082f56d2-bd7d-41e3-bdbd-ed4fa2a5582c req-0edda38c-a095-44d9-af7e-1748854d51fa service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received unexpected event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 for instance with vm_state active and task_state None.
Nov 02 23:27:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:56 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.compute.manager [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] No waiting events found dispatching network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:27:57 user nova-compute[74721]: WARNING nova.compute.manager [req-889d313c-600c-4cfe-bd44-400f9d40bd0e req-16be661d-4cf3-4744-abad-aa2749e711ad service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received unexpected event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 for instance with vm_state building and task_state spawning.
Nov 02 23:27:57 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Instance spawned successfully.
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:27:57 user nova-compute[74721]: INFO nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:57 user nova-compute[74721]: INFO nova.compute.manager [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Took 6.43 seconds to build instance.
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b20686a0-425c-4944-9e45-708da68cf6eb tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.532s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:27:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:59 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=24.98033905029297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 6720caac-bc25-4335-9cc3-6916e1c59003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:27:59 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:28:19 user nova-compute[74721]: INFO nova.compute.claims [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Claim successful on node user
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:28:19 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:28:19 user nova-compute[74721]: INFO nova.virt.block_device [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Booting with volume-backed-image bf81f74d-ac5b-4b08-8444-661e551c1f11 at /dev/vda
Nov 02 23:28:19 user nova-compute[74721]: DEBUG nova.policy [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b54b65445a47929910242fa7206851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0a955207b54b909bf41ecfc6198291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:28:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:20 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Successfully created port: 3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Successfully updated port: 3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-changed-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.compute.manager [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Refreshing instance network info cache due to event network-changed-3ddcc913-9e6d-43d4-8ac4-66a5515fede7. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] Acquiring lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating instance_info_cache with network_info: [{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance network_info: |[{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] Acquired lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Refreshing network info cache for port 3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:28:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updated VIF entry in instance network info cache for port 3ddcc913-9e6d-43d4-8ac4-66a5515fede7. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:28:22 user nova-compute[74721]: DEBUG nova.network.neutron [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating instance_info_cache with network_info: [{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:28:22 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a4271da4-4f2f-4f4b-a8c5-43a6cb2918aa req-5b33055d-b662-4aa1-8c6c-09a1edde643d service nova] Releasing lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:28:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:28:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.utils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f4f01-02ce-4d4b-ae86-db7ef5c71896]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e22ef-0099-400c-9140-b72b4985bbc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44541642-31f3-4132-a778-b8f9320c6d69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1681587-1570-47de-8db8-37f3827c5b4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:28:40 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:28:40 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae28f01-28f6-4ac4-a714-2d4358488f71]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG os_brick.utils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:28:40 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating existing volume attachment record: 2d829dbf-31a6-416f-93cc-e190c171cb74 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:28:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:46 user nova-compute[74721]: INFO nova.compute.manager [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Terminating instance
Nov 02 23:28:46 user nova-compute[74721]: DEBUG nova.compute.manager [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-unplugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] No waiting events found dispatching network-vif-unplugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:28:46 user nova-compute[74721]: DEBUG nova.compute.manager [req-79d373ad-d8d9-4e06-8aa0-739bb7d464ad req-347fa724-430f-416e-b6d0-7c9f867e67d3 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-unplugged-15c2bf17-0db1-4151-ae86-8a3527e25201 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Instance destroyed successfully.
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.objects.instance [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lazy-loading 'resources' on Instance uuid 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209426409',display_name='tempest-VolumesActionsTest-instance-209426409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209426409',id=46,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0d0d6d154314d36865ec3c6216bae49',ramdisk_id='',reservation_id='r-1pqy1stk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1934758221',owner_user_name='tempest-VolumesActionsTest-1934758221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:27:03Z,user_data=None,user_id='3130ca86007b4dc7b19966c8fdc2c0ce',uuid=29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converting VIF {"id": "15c2bf17-0db1-4151-ae86-8a3527e25201", "address": "fa:16:3e:0e:b4:d4", "network": {"id": "4199eaff-e717-4a30-bb33-1e10c092ab92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8040351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0d0d6d154314d36865ec3c6216bae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c2bf17-0d", "ovs_interfaceid": "15c2bf17-0db1-4151-ae86-8a3527e25201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG os_vif [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15c2bf17-0d, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8841c55-11a2-4ae6-bd11-151d606fb997) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:47 user nova-compute[74721]: INFO os_vif [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:d4,bridge_name='br-int',has_traffic_filtering=True,id=15c2bf17-0db1-4151-ae86-8a3527e25201,network=Network(4199eaff-e717-4a30-bb33-1e10c092ab92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c2bf17-0d')
Nov 02 23:28:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Deleting instance files /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea_del
Nov 02 23:28:47 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Deletion of /opt/stack/data/nova/instances/29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea_del complete
Nov 02 23:28:47 user nova-compute[74721]: INFO nova.compute.manager [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:28:47 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Took 0.77 seconds to deallocate network for instance.
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.compute.manager [req-b88aa46e-5b63-4c39-bbc3-a975625ac139 req-285db9bb-73f7-4ef1-aeb8-d0d6e096958f service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-deleted-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:48 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Deleted allocations for instance 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-935c2478-50ae-4618-b2b1-02c94587c8a2 tempest-VolumesActionsTest-1934758221 tempest-VolumesActionsTest-1934758221-project-member] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] Acquiring lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] Lock "29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:48 user nova-compute[74721]: DEBUG nova.compute.manager [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] No waiting events found dispatching network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:28:48 user nova-compute[74721]: WARNING nova.compute.manager [req-10da43d4-58ee-4345-a22b-7567f7798f37 req-7b5b1561-2547-4eb5-aeec-b601f9b31735 service nova] [instance: 29dbfbf2-a0c0-446f-88b1-c0eb8676d8ea] Received unexpected event network-vif-plugged-15c2bf17-0db1-4151-ae86-8a3527e25201 for instance with vm_state deleted and task_state None.
Nov 02 23:28:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:28:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:28:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:28:58 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:28:59 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:29:00 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8403MB free_disk=24.977893829345703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:29:00 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Creating image(s)
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Ensure instance console log exists: /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start _get_guest_xml network_info=[{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '2d829dbf-31a6-416f-93cc-e190c171cb74', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bbfc456-48bd-42a1-ad15-d78cbc7973f1', 'attached_at': '', 'detached_at': '', 'volume_id': '4be55c2f-2014-486b-835e-58ea83037c35', 'serial': '4be55c2f-2014-486b-835e-58ea83037c35'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:29:00 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:29:00 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:29:00 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:29:00 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:29:00 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 6720caac-bc25-4335-9cc3-6916e1c59003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b664a3-10f8-4bd8-a526-a20a76694c10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:29:00 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdd8d1e-fa4b-4349-ac04-ffa4e338a917]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35] added
Nov 02 23:29:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a47b47-d9cb-4ee4-b632-7d6863941615]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1180deb2-fe75-4710-8c95-e3288e1c4f9e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXGuOZbL {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXGuOZbL" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d89611-2687-4558-985c-3c2d97611bcd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KXGuOZbL'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283ec8c-b2af-4c80-a9c9-e7f8f2f21da7]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7151a1d2-a437-46c5-988b-fdaef6249284]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:00 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:00 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4f9cf-0b0a-4b8f-bb05-b1c296cf3183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260]
Nov 02 23:29:00 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260] successful.
Nov 02 23:29:00 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e5de0c-15e4-4c19-9ca3-6d6432765d15]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:00 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a227e6-a893-47c1-8ac3-6d64637de4bb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:29:01 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10cf346-5563-4660-bd78-17eef64f94e1]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:29:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23562643031333066', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643031333066', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668295238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668295238',id=49,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-1crpy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:28:20Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=1bbfc456-48bd-42a1-ad15-d78cbc7973f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:29:02 user nova-compute[74721]:   <uuid>1bbfc456-48bd-42a1-ad15-d78cbc7973f1</uuid>
Nov 02 23:29:02 user nova-compute[74721]:   <name>instance-00000031</name>
Nov 02 23:29:02 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:29:02 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:29:02 user nova-compute[74721]:   <metadata>
Nov 02 23:29:02 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:29:02 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-668295238</nova:name>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:29:00</nova:creationTime>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:29:02 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:29:02 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:owner>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:29:02 user nova-compute[74721]:       </nova:owner>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:29:02 user nova-compute[74721]:       <nova:ports>
Nov 02 23:29:02 user nova-compute[74721]:         <nova:port uuid="3ddcc913-9e6d-43d4-8ac4-66a5515fede7">
Nov 02 23:29:02 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:29:02 user nova-compute[74721]:         </nova:port>
Nov 02 23:29:02 user nova-compute[74721]:       </nova:ports>
Nov 02 23:29:02 user nova-compute[74721]:     </nova:instance>
Nov 02 23:29:02 user nova-compute[74721]:   </metadata>
Nov 02 23:29:02 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:29:02 user nova-compute[74721]:     <system>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="serial">1bbfc456-48bd-42a1-ad15-d78cbc7973f1</entry>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="uuid">1bbfc456-48bd-42a1-ad15-d78cbc7973f1</entry>
Nov 02 23:29:02 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:29:02 user nova-compute[74721]:     </system>
Nov 02 23:29:02 user nova-compute[74721]:   </sysinfo>
Nov 02 23:29:02 user nova-compute[74721]:   <os>
Nov 02 23:29:02 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:29:02 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:29:02 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:29:02 user nova-compute[74721]:   </os>
Nov 02 23:29:02 user nova-compute[74721]:   <features>
Nov 02 23:29:02 user nova-compute[74721]:     <acpi/>
Nov 02 23:29:02 user nova-compute[74721]:     <apic/>
Nov 02 23:29:02 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:29:02 user nova-compute[74721]:   </features>
Nov 02 23:29:02 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:29:02 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:29:02 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:29:02 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:29:02 user nova-compute[74721]:   </clock>
Nov 02 23:29:02 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:29:02 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:29:02 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:29:02 user nova-compute[74721]:   </cpu>
Nov 02 23:29:02 user nova-compute[74721]:   <devices>
Nov 02 23:29:02 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:29:02 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:29:02 user nova-compute[74721]:       <source dev="/dev/sdd"/>
Nov 02 23:29:02 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:29:02 user nova-compute[74721]:       <serial>4be55c2f-2014-486b-835e-58ea83037c35</serial>
Nov 02 23:29:02 user nova-compute[74721]:     </disk>
Nov 02 23:29:02 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:29:02 user nova-compute[74721]:       <mac address="fa:16:3e:4a:f8:fd"/>
Nov 02 23:29:02 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:29:02 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:29:02 user nova-compute[74721]:       <target dev="tap3ddcc913-9e"/>
Nov 02 23:29:02 user nova-compute[74721]:     </interface>
Nov 02 23:29:02 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:29:02 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/console.log" append="off"/>
Nov 02 23:29:02 user nova-compute[74721]:     </serial>
Nov 02 23:29:02 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:29:02 user nova-compute[74721]:     <video>
Nov 02 23:29:02 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:29:02 user nova-compute[74721]:     </video>
Nov 02 23:29:02 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:29:02 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:29:02 user nova-compute[74721]:     </rng>
Nov 02 23:29:02 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:29:02 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:29:02 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:29:02 user nova-compute[74721]:     </memballoon>
Nov 02 23:29:02 user nova-compute[74721]:   </devices>
Nov 02 23:29:02 user nova-compute[74721]: </domain>
Nov 02 23:29:02 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668295238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668295238',id=49,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-1crpy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:28:20Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=1bbfc456-48bd-42a1-ad15-d78cbc7973f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG os_vif [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f337901-7958-57a5-9542-26b0eba50163', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ddcc913-9e, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ddcc913-9e, col_values=(('qos', UUID('0d85fac9-4369-4e82-acfb-23152162e609')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ddcc913-9e, col_values=(('external_ids', {'iface-id': '3ddcc913-9e6d-43d4-8ac4-66a5515fede7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f8:fd', 'vm-uuid': '1bbfc456-48bd-42a1-ad15-d78cbc7973f1'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:02 user nova-compute[74721]: INFO os_vif [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e')
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:29:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:4a:f8:fd, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:03 user nova-compute[74721]: DEBUG nova.compute.manager [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:29:03 user nova-compute[74721]: WARNING nova.compute.manager [req-78206b8f-85d0-4d24-b249-5bed474508c6 req-8022313a-3339-48a9-8821-4a6b7096d1ce service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state building and task_state spawning.
Nov 02 23:29:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:29:05 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance spawned successfully.
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:29:05 user nova-compute[74721]: INFO nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:29:05 user nova-compute[74721]: WARNING nova.compute.manager [req-d950adce-122e-4a14-9b6d-8bd0af9c61a7 req-1a6e1033-8455-4086-a031-01a1f435953c service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state building and task_state spawning.
Nov 02 23:29:05 user nova-compute[74721]: INFO nova.compute.manager [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Took 46.70 seconds to build instance.
Nov 02 23:29:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cbc9e4e5-dfa3-4f1a-bd95-3caeab84c548 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.796s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:07 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-changed-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.compute.manager [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Refreshing instance network info cache due to event network-changed-5e57adf8-906c-4f79-ac85-f9370cd47157. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] Acquiring lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] Acquired lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.network.neutron [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Refreshing network info cache for port 5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:10 user nova-compute[74721]: INFO nova.compute.manager [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Terminating instance
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.compute.manager [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.network.neutron [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updated VIF entry in instance network info cache for port 5e57adf8-906c-4f79-ac85-f9370cd47157. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG nova.network.neutron [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updating instance_info_cache with network_info: [{"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-3646a24f-6a65-439d-822f-72fa9840aee5 req-0f58d0dc-c0ef-4407-b495-b943d85f9678 service nova] Releasing lock "refresh_cache-6720caac-bc25-4335-9cc3-6916e1c59003" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-unplugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] No waiting events found dispatching network-vif-unplugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-9ce51ed4-dce9-4b62-93a9-6ecba4eceaa5 req-2629787d-694f-468e-be59-41dd7a24f33a service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-unplugged-5e57adf8-906c-4f79-ac85-f9370cd47157 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:29:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Instance destroyed successfully.
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid 6720caac-bc25-4335-9cc3-6916e1c59003 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-855479161',display_name='tempest-TestVolumeBootPattern-server-855479161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-855479161',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-clllgigk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:27:55Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=6720caac-bc25-4335-9cc3-6916e1c59003,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "5e57adf8-906c-4f79-ac85-f9370cd47157", "address": "fa:16:3e:65:f3:0d", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e57adf8-90", "ovs_interfaceid": "5e57adf8-906c-4f79-ac85-f9370cd47157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_vif [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e57adf8-90, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7328c8f-5d2b-4769-9553-38a7f282c3b1) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:29:11 user nova-compute[74721]: INFO os_vif [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f3:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e57adf8-906c-4f79-ac85-f9370cd47157,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e57adf8-90')
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:29:11 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14f7d98-4569-4062-9a83-feb2c241b670]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:29:11 user nova-compute[74721]: No targets found.
Nov 02 23:29:11 user nova-compute[74721]: iSNS:
Nov 02 23:29:11 user nova-compute[74721]: No targets found.
Nov 02 23:29:11 user nova-compute[74721]: STATIC:
Nov 02 23:29:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35
Nov 02 23:29:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:29:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:29:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:29:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:29:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:29:11 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:29:11 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:29:11 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:29:11 user nova-compute[74721]: FIRMWARE:
Nov 02 23:29:11 user nova-compute[74721]: No targets found.
Nov 02 23:29:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:29:11 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:29:11 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c044d1b-7a53-4f45-932c-6ced71ea0f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0adfd96-8f54-4470-acca-28109609f08e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:29:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf47fc76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc8e082-4463-4840-8283-44bd0120af9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[277055cd-1db7-45d3-a62d-550bfe924cf0]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8c413-33dc-4fe1-85ff-31e1fddc8f39]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b100248-11a8-4e1b-857a-7ca8e82f8b83]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f7e6ba4', '/dev/disk/by-id/scsi-1SCST_BIO9f7e6ba4-76a9219e721a3ce0', '/dev/disk/by-id/scsi-23736613932313965') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a6de2-c772-4daa-b66c-e792bca57dc9]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5e103-4629-4802-a72d-22395d43bd94]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd526ea6-d352-4248-8329-10617eca539a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]
Nov 02 23:29:11 user nova-compute[74721]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.
Nov 02 23:29:11 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e1cfe-f7a9-4871-8644-bc6bbff71a18]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (337ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:29:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Deleting instance files /opt/stack/data/nova/instances/6720caac-bc25-4335-9cc3-6916e1c59003_del
Nov 02 23:29:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Deletion of /opt/stack/data/nova/instances/6720caac-bc25-4335-9cc3-6916e1c59003_del complete
Nov 02 23:29:11 user nova-compute[74721]: INFO nova.compute.manager [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 02 23:29:11 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:29:11 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] Acquiring lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] Lock "6720caac-bc25-4335-9cc3-6916e1c59003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] No waiting events found dispatching network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:29:13 user nova-compute[74721]: WARNING nova.compute.manager [req-1facb8a4-bb7c-4a46-b4de-cef7d20f7c95 req-350a31da-615d-4feb-b597-ffe30f8812b8 service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received unexpected event network-vif-plugged-5e57adf8-906c-4f79-ac85-f9370cd47157 for instance with vm_state active and task_state deleting.
Nov 02 23:29:13 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Took 1.41 seconds to deallocate network for instance.
Nov 02 23:29:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-219890d2-bd60-4e0b-be76-1344356ab0a4 req-c34e042f-e2aa-4c42-ba90-79799bf6215d service nova] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Received event network-vif-deleted-5e57adf8-906c-4f79-ac85-f9370cd47157 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:14 user nova-compute[74721]: INFO nova.compute.manager [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 6720caac-bc25-4335-9cc3-6916e1c59003] Took 1.03 seconds to detach 1 volumes for instance.
Nov 02 23:29:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:14 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:29:14 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:29:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:14 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance 6720caac-bc25-4335-9cc3-6916e1c59003
Nov 02 23:29:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-9d341508-ed8e-4da2-9a82-d7c9a05cbc74 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "6720caac-bc25-4335-9cc3-6916e1c59003" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.235s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing instance network info cache due to event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] Acquiring lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] Acquired lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updated VIF entry in instance network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:29:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ca854585-70b1-4415-887d-0a102fc68c98 req-33fc5b35-b165-4f49-bf5b-fac9dace39ce service nova] Releasing lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:29:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:29:44 user nova-compute[74721]: INFO nova.compute.manager [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Attaching volume fd81943a-87c1-4753-a007-a47c22742337 to /dev/vdb
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.utils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730ae1b-e356-43af-bdd7-803d0b992267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208984f-0f82-46f8-b791-da843fec1dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d01d1b-b96c-4438-b7f7-918c97888472]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacee7ff-6e00-4ff7-8cde-ca6f2e308e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:29:45 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:29:45 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff98ca-50d9-4837-8a2d-b3404933ddec]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG os_brick.utils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:29:45 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating existing volume attachment record: e97c1a26-7a53-4c34-921c-39311e77748d {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:29:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:29:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:47 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:47 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:29:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:29:47 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:29:47 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:29:48 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:29:48 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:29:48 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:29:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:29:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:29:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:29:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:00 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:01 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:02 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:02 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=24.96695327758789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:30:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:30:03 user nova-compute[74721]: INFO nova.compute.claims [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Claim successful on node user
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:30:03 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG nova.policy [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:30:03 user nova-compute[74721]: INFO nova.virt.block_device [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Booting with volume 776c1c64-888f-4081-996f-6562beb32c53 at /dev/vda
Nov 02 23:30:03 user nova-compute[74721]: DEBUG os_brick.utils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a8e24-a0ce-41cd-8649-f4d0864423b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908ca74-2e0e-420c-a5ce-843b036e608d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[611219a9-7e37-4190-a26c-906db4208e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c1d30f-d462-43a6-b142-f4229da262f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:30:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:30:04 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:30:04 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d384e23-5d4c-487a-8fad-8209f5470e41]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG os_brick.utils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating existing volume attachment record: d8495080-c6c0-4f12-9399-82d4e7d2ca44 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:30:04 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Successfully created port: b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Successfully updated port: b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing instance network info cache due to event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] Acquiring lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.network.neutron [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating instance_info_cache with network_info: [{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Instance network_info: |[{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] Acquired lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:30:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybQlOhgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:30:06 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:06 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:06 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7b208-0f34-480b-a388-9dbe7507c1dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:30:06 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updated VIF entry in instance network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating instance_info_cache with network_info: [{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c5afcd89-8233-4cc4-9443-7a12b759ab91 req-68a93e84-acd9-4da9-86fa-f4fb704e3fe2 service nova] Releasing lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0dec1-e1be-40a8-b391-be7b87e62a7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337] added
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7473388-712f-49fd-84aa-b0930ac84a84]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d000cfd7-1681-46df-b085-7ba6f433fd06]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybQlOhgu {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybQlOhgu" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[997775be-6305-4692-8722-6ddea2441ca5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybQlOhgu'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ba4af-da22-4d7a-972f-6e2c06a2fb8b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefed920-33ba-475f-a72d-ad1ddd786ac2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f73fb3b-82a9-4964-979a-8736eaf78c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260]
Nov 02 23:30:06 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260] successful.
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9924f-ec96-431a-bd9c-4ebd7e073869]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d580dcb-1f05-428a-83f9-53adfac0a1d5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.042s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea4ca75-8637-43fc-afc6-d29c490ac9f1]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybQlOhgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:30:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:07 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26131363139333139', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:30:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131363139333139', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:30:07 user nova-compute[74721]: DEBUG nova.objects.instance [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:30:07 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:30:07 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:30:07 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:30:07 user nova-compute[74721]:   <serial>fd81943a-87c1-4753-a007-a47c22742337</serial>
Nov 02 23:30:07 user nova-compute[74721]: </disk>
Nov 02 23:30:07 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:30:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:30:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:30:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No VIF found with MAC fa:16:3e:a8:55:77, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:30:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-a90fe8a9-63d3-4c3b-b2be-b5d2ba0485fe tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.113s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:10 user nova-compute[74721]: INFO nova.compute.manager [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Rescuing
Nov 02 23:30:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:30:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:30:10 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:30:10 user nova-compute[74721]: DEBUG nova.network.neutron [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating instance_info_cache with network_info: [{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:30:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG nova.compute.manager [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:11 user nova-compute[74721]: WARNING nova.compute.manager [req-4889475f-3e78-4bef-9c6c-65c5d8f5adb3 req-3f6678ed-f3af-4f82-acaf-f054b1f82cc2 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state active and task_state rescuing.
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance destroyed successfully.
Nov 02 23:30:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Attempting a stable device rescue
Nov 02 23:30:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74721) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance directory exists: not creating {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 23:30:11 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Creating image(s)
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:11 user nova-compute[74721]: INFO nova.compute.manager [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Detaching volume fd81943a-87c1-4753-a007-a47c22742337
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:13 user nova-compute[74721]: INFO nova.virt.block_device [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Attempting to driver detach volume fd81943a-87c1-4753-a007-a47c22742337 from mountpoint /dev/vdb
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Attempting to detach device vdb from instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:30:13 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:30:13 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:30:13 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:30:13 user nova-compute[74721]:   <serial>fd81943a-87c1-4753-a007-a47c22742337</serial>
Nov 02 23:30:13 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:30:13 user nova-compute[74721]: </disk>
Nov 02 23:30:13 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:30:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully detached device vdb from instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 from the persistent domain config.
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:30:13 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:30:13 user nova-compute[74721]:   <source dev="/dev/sde"/>
Nov 02 23:30:13 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:30:13 user nova-compute[74721]:   <serial>fd81943a-87c1-4753-a007-a47c22742337</serial>
Nov 02 23:30:13 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:30:13 user nova-compute[74721]: </disk>
Nov 02 23:30:13 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.images [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] 8c6ef97d-0b4d-452f-a32d-035420bba0f5 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.part /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.compute.manager [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:13 user nova-compute[74721]: WARNING nova.compute.manager [req-2335afe6-d1ca-48c6-8c3d-092ab8179015 req-b43d6707-1ca6-4133-98db-139c177fba33 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state active and task_state rescuing.
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.part /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.converted" returned: 0 in 0.268s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11 --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11 --force-share --output=json" returned: 0 in 0.202s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11,backing_fmt=raw /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11,backing_fmt=raw /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue" returned: 0 in 0.055s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "5147cb59264add6857dc3ef49838b9dc85ba6a11" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'migration_context' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<1bbfc456-48bd-42a1-ad15-d78cbc7973f1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start _get_guest_xml network_info=[{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:4a:f8:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8c6ef97d-0b4d-452f-a32d-035420bba0f5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '2d829dbf-31a6-416f-93cc-e190c171cb74', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1bbfc456-48bd-42a1-ad15-d78cbc7973f1', 'attached_at': '', 'detached_at': '', 'volume_id': '4be55c2f-2014-486b-835e-58ea83037c35', 'serial': '4be55c2f-2014-486b-835e-58ea83037c35'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<1bbfc456-48bd-42a1-ad15-d78cbc7973f1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'numa_topology' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<1bbfc456-48bd-42a1-ad15-d78cbc7973f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:30:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:14 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T22:51:47Z,direct_url=<?>,disk_format='qcow2',id=bf81f74d-ac5b-4b08-8444-661e551c1f11,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b33085dace814e56b515e6d436a2e9a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T22:51:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<1bbfc456-48bd-42a1-ad15-d78cbc7973f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:30:14 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:14 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:14 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260" returned: 0 in 0.154s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5711984-8d70-40b5-9681-1af994d618d6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KXGuOZbL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 23:30:14 user nova-compute[74721]: node.name = iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35
Nov 02 23:30:14 user nova-compute[74721]: node.tpgt = -1
Nov 02 23:30:14 user nova-compute[74721]: node.startup = automatic
Nov 02 23:30:14 user nova-compute[74721]: node.leading_login = No
Nov 02 23:30:14 user nova-compute[74721]: iface.iscsi_ifacename = default
Nov 02 23:30:14 user nova-compute[74721]: iface.net_ifacename = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.ipaddress = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.prefix_len = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.hwaddress = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.transport_name = tcp
Nov 02 23:30:14 user nova-compute[74721]: iface.initiatorname = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.vlan_id = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.vlan_priority = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.vlan_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.iface_num = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.mtu = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.port = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.bootproto = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.subnet_mask = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.gateway = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_alt_client_id = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_dns = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_learn_iqn = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_vendor_id_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_vendor_id = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.dhcp_slp_da = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.fragmentation = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.gratuitous_arp = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.incoming_forwarding = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.tos_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.tos = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.ttl = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.delayed_ack = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.tcp_nagle = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.tcp_wsf_state = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.tcp_wsf = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.tcp_timer_scale = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.tcp_timestamp = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.redirect = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.def_task_mgmt_timeout = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.header_digest = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.data_digest = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.immediate_data = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.initial_r2t = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.data_seq_inorder = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.data_pdu_inorder = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.erl = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.max_receive_data_len = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.first_burst_len = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.max_outstanding_r2t = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.max_burst_len = 0
Nov 02 23:30:14 user nova-compute[74721]: iface.chap_auth = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.bidi_chap = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.strict_login_compliance = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.discovery_auth = <empty>
Nov 02 23:30:14 user nova-compute[74721]: iface.discovery_logout = <empty>
Nov 02 23:30:14 user nova-compute[74721]: node.discovery_address = <empty>
Nov 02 23:30:14 user nova-compute[74721]: node.discovery_port = 0
Nov 02 23:30:14 user nova-compute[74721]: node.discovery_type = static
Nov 02 23:30:14 user nova-compute[74721]: node.session.initial_cmdsn = 0
Nov 02 23:30:14 user nova-compute[74721]: node.session.initial_login_retry_max = 8
Nov 02 23:30:14 user nova-compute[74721]: node.session.xmit_thread_priority = -20
Nov 02 23:30:14 user nova-compute[74721]: node.session.cmds_max = 128
Nov 02 23:30:14 user nova-compute[74721]: node.session.queue_depth = 32
Nov 02 23:30:14 user nova-compute[74721]: node.session.nr_sessions = 1
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.authmethod = CHAP
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.username = KXGuOZbL
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.password = ***
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.username_in = <empty>
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.password_in = <empty>
Nov 02 23:30:14 user nova-compute[74721]: node.session.auth.chap_algs = MD5
Nov 02 23:30:14 user nova-compute[74721]: node.session.timeo.replacement_timeout = 120
Nov 02 23:30:14 user nova-compute[74721]: node.session.err_timeo.abort_timeout = 15
Nov 02 23:30:14 user nova-compute[74721]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 23:30:14 user nova-compute[74721]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 23:30:14 user nova-compute[74721]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.FastAbort = Yes
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.InitialR2T = No
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.ImmediateData = Yes
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.MaxConnections = 1
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 23:30:14 user nova-compute[74721]: node.session.iscsi.ERL = 0
Nov 02 23:30:14 user nova-compute[74721]: node.session.scan = manual
Nov 02 23:30:14 user nova-compute[74721]: node.session.reopen_max = 0
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].address = 172.16.0.220
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].port = 3260
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].startup = manual
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].tcp.window_size = 524288
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].tcp.type_of_service = 0
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].timeo.logout_timeout = 15
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].timeo.login_timeout = 15
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].timeo.auth_timeout = 45
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.DataDigest = None
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.IFMarker = No
Nov 02 23:30:14 user nova-compute[74721]: node.conn[0].iscsi.OFMarker = No
Nov 02 23:30:14 user nova-compute[74721]: # END RECORD
Nov 02 23:30:14 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc075d81-c335-42ec-b6e7-ddabca3cfa64]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.130s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c17b4-2a4b-4c40-b4bb-e5f5c5026c70]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXGuOZbL {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXGuOZbL" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ce611-a033-4d1d-87ab-d219e9f72dbf]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KXGuOZbL'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.083s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd5654-c74d-461d-9b6d-0e3c894a76b6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78582da2-41eb-452d-b2ba-80be7b309c50]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9174cbfd-671a-4c66-9527-abaa8dcf6147 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:14 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.525s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] HCTL ('35', '0', '0', 0) found on session 55 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d39841-cc0c-4382-ae0f-d0e288807736]: (4, ('0 0 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Searching for a device in session 55 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.564s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== connect_volume: return (565ms) {'type': 'block', 'scsi_wwn': '23562643031333066', 'path': '/dev/sdd'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643031333066', 'path': '/dev/sdd'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668295238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668295238',id=49,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-1crpy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:29:06Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=1bbfc456-48bd-42a1-ad15-d78cbc7973f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:4a:f8:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "vif_mac": "fa:16:3e:4a:f8:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.instance [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.objects.base [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Object Instance<1bbfc456-48bd-42a1-ad15-d78cbc7973f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74721) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 23:30:14 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:30:14 user nova-compute[74721]:   <uuid>1bbfc456-48bd-42a1-ad15-d78cbc7973f1</uuid>
Nov 02 23:30:14 user nova-compute[74721]:   <name>instance-00000031</name>
Nov 02 23:30:14 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:30:14 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:30:14 user nova-compute[74721]:   <metadata>
Nov 02 23:30:14 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:30:14 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-668295238</nova:name>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:30:14</nova:creationTime>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:30:14 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:30:14 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:owner>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:user uuid="c0b54b65445a47929910242fa7206851">tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member</nova:user>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:project uuid="6b0a955207b54b909bf41ecfc6198291">tempest-ServerBootFromVolumeStableRescueTest-1796337083</nova:project>
Nov 02 23:30:14 user nova-compute[74721]:       </nova:owner>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:root type="image" uuid="bf81f74d-ac5b-4b08-8444-661e551c1f11"/>
Nov 02 23:30:14 user nova-compute[74721]:       <nova:ports>
Nov 02 23:30:14 user nova-compute[74721]:         <nova:port uuid="3ddcc913-9e6d-43d4-8ac4-66a5515fede7">
Nov 02 23:30:14 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 23:30:14 user nova-compute[74721]:         </nova:port>
Nov 02 23:30:14 user nova-compute[74721]:       </nova:ports>
Nov 02 23:30:14 user nova-compute[74721]:     </nova:instance>
Nov 02 23:30:14 user nova-compute[74721]:   </metadata>
Nov 02 23:30:14 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:30:14 user nova-compute[74721]:     <system>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="serial">1bbfc456-48bd-42a1-ad15-d78cbc7973f1</entry>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="uuid">1bbfc456-48bd-42a1-ad15-d78cbc7973f1</entry>
Nov 02 23:30:14 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:30:14 user nova-compute[74721]:     </system>
Nov 02 23:30:14 user nova-compute[74721]:   </sysinfo>
Nov 02 23:30:14 user nova-compute[74721]:   <os>
Nov 02 23:30:14 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:30:14 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:30:14 user nova-compute[74721]:   </os>
Nov 02 23:30:14 user nova-compute[74721]:   <features>
Nov 02 23:30:14 user nova-compute[74721]:     <acpi/>
Nov 02 23:30:14 user nova-compute[74721]:     <apic/>
Nov 02 23:30:14 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:30:14 user nova-compute[74721]:   </features>
Nov 02 23:30:14 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:30:14 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:30:14 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:30:14 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:30:14 user nova-compute[74721]:   </clock>
Nov 02 23:30:14 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:30:14 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:30:14 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:30:14 user nova-compute[74721]:   </cpu>
Nov 02 23:30:14 user nova-compute[74721]:   <devices>
Nov 02 23:30:14 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:30:14 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:30:14 user nova-compute[74721]:       <source dev="/dev/sdd"/>
Nov 02 23:30:14 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:30:14 user nova-compute[74721]:       <serial>4be55c2f-2014-486b-835e-58ea83037c35</serial>
Nov 02 23:30:14 user nova-compute[74721]:     </disk>
Nov 02 23:30:14 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:30:14 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:30:14 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue"/>
Nov 02 23:30:14 user nova-compute[74721]:       <target dev="vdb" bus="virtio"/>
Nov 02 23:30:14 user nova-compute[74721]:       <boot order="1"/>
Nov 02 23:30:14 user nova-compute[74721]:     </disk>
Nov 02 23:30:14 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:30:14 user nova-compute[74721]:       <mac address="fa:16:3e:4a:f8:fd"/>
Nov 02 23:30:14 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:30:14 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:30:14 user nova-compute[74721]:       <target dev="tap3ddcc913-9e"/>
Nov 02 23:30:14 user nova-compute[74721]:     </interface>
Nov 02 23:30:14 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:30:14 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/console.log" append="off"/>
Nov 02 23:30:14 user nova-compute[74721]:     </serial>
Nov 02 23:30:14 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:30:14 user nova-compute[74721]:     <video>
Nov 02 23:30:14 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:30:14 user nova-compute[74721]:     </video>
Nov 02 23:30:14 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:30:14 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:30:14 user nova-compute[74721]:     </rng>
Nov 02 23:30:14 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:30:14 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:30:14 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:30:14 user nova-compute[74721]:     </memballoon>
Nov 02 23:30:14 user nova-compute[74721]:   </devices>
Nov 02 23:30:14 user nova-compute[74721]: </domain>
Nov 02 23:30:14 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:30:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance destroyed successfully.
Nov 02 23:30:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:30:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:30:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] No VIF found with MAC fa:16:3e:4a:f8:fd, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:17 user nova-compute[74721]: WARNING nova.compute.manager [req-5d7c8ef9-8bb2-4228-b9a6-96758ad264d8 req-e9d0c007-2b28-43f0-a34c-06bfb084fd83 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state active and task_state rescuing.
Nov 02 23:30:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG nova.compute.manager [None req-68e734e2-d789-4db6-a91e-57e50ef67e11 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:19 user nova-compute[74721]: WARNING nova.compute.manager [req-e576c926-582a-483a-88b5-7b6f87493f0f req-7af0576d-7c6e-47c0-985b-aa89cbc386bd service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state active and task_state rescuing.
Nov 02 23:30:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:30:27 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Creating image(s)
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Start _get_guest_xml network_info=[{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'd8495080-c6c0-4f12-9399-82d4e7d2ca44', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce', 'attached_at': '', 'detached_at': '', 'volume_id': '776c1c64-888f-4081-996f-6562beb32c53', 'serial': '776c1c64-888f-4081-996f-6562beb32c53'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:30:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:27 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:30:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:27 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:27 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b721a-a3da-4962-9eb7-4728c829b9e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:30:27 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28310b8b-31c7-4466-abc6-b4278c63bb3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53] added
Nov 02 23:30:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f2ec06-d4ad-4234-bc0e-b96a435bb8e5]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[452cfd9a-0ccf-4826-ae66-b3ad75a5ee7d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhYaUQHk {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhYaUQHk" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf893ea-295c-43a2-a598-e11aa8c1829d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhYaUQHk'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b3378-3d50-4e72-8551-9e7615de1580]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3aa3fa-813f-4eb9-ac76-3fb4a490cbfb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[06673f49-9328-4868-b4e6-a1874437daf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]
Nov 02 23:30:27 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.
Nov 02 23:30:27 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f683b-2ad3-485a-a171-4563b9cc545b]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:27 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c05f0-fbfa-4a8c-966d-386ea2fe8435]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:30:28 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f1055-536d-44df-af0c-ba6a9ea2029f]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:28 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23736613932313965', 'path': '/dev/sdc'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613932313965', 'path': '/dev/sdc'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1901706543',display_name='tempest-TestVolumeBootPattern-server-1901706543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1901706543',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pq54m0yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:30:04Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.objects.instance [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:30:29 user nova-compute[74721]:   <uuid>8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce</uuid>
Nov 02 23:30:29 user nova-compute[74721]:   <name>instance-00000032</name>
Nov 02 23:30:29 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:30:29 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:30:29 user nova-compute[74721]:   <metadata>
Nov 02 23:30:29 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:30:29 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:30:29 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-server-1901706543</nova:name>
Nov 02 23:30:29 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:30:27</nova:creationTime>
Nov 02 23:30:29 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:30:29 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:30:29 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:30:29 user nova-compute[74721]:       <nova:owner>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:30:29 user nova-compute[74721]:       </nova:owner>
Nov 02 23:30:29 user nova-compute[74721]:       <nova:ports>
Nov 02 23:30:29 user nova-compute[74721]:         <nova:port uuid="b1f5ca79-972d-4df3-8b4b-1cee04d5ae85">
Nov 02 23:30:29 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 23:30:29 user nova-compute[74721]:         </nova:port>
Nov 02 23:30:29 user nova-compute[74721]:       </nova:ports>
Nov 02 23:30:29 user nova-compute[74721]:     </nova:instance>
Nov 02 23:30:29 user nova-compute[74721]:   </metadata>
Nov 02 23:30:29 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:30:29 user nova-compute[74721]:     <system>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="serial">8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce</entry>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="uuid">8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce</entry>
Nov 02 23:30:29 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:30:29 user nova-compute[74721]:     </system>
Nov 02 23:30:29 user nova-compute[74721]:   </sysinfo>
Nov 02 23:30:29 user nova-compute[74721]:   <os>
Nov 02 23:30:29 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:30:29 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:30:29 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:30:29 user nova-compute[74721]:   </os>
Nov 02 23:30:29 user nova-compute[74721]:   <features>
Nov 02 23:30:29 user nova-compute[74721]:     <acpi/>
Nov 02 23:30:29 user nova-compute[74721]:     <apic/>
Nov 02 23:30:29 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:30:29 user nova-compute[74721]:   </features>
Nov 02 23:30:29 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:30:29 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:30:29 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:30:29 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:30:29 user nova-compute[74721]:   </clock>
Nov 02 23:30:29 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:30:29 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:30:29 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:30:29 user nova-compute[74721]:   </cpu>
Nov 02 23:30:29 user nova-compute[74721]:   <devices>
Nov 02 23:30:29 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:30:29 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:30:29 user nova-compute[74721]:       <source dev="/dev/sdc"/>
Nov 02 23:30:29 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:30:29 user nova-compute[74721]:       <serial>776c1c64-888f-4081-996f-6562beb32c53</serial>
Nov 02 23:30:29 user nova-compute[74721]:     </disk>
Nov 02 23:30:29 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:30:29 user nova-compute[74721]:       <mac address="fa:16:3e:fb:35:b0"/>
Nov 02 23:30:29 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:30:29 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:30:29 user nova-compute[74721]:       <target dev="tapb1f5ca79-97"/>
Nov 02 23:30:29 user nova-compute[74721]:     </interface>
Nov 02 23:30:29 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:30:29 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce/console.log" append="off"/>
Nov 02 23:30:29 user nova-compute[74721]:     </serial>
Nov 02 23:30:29 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:30:29 user nova-compute[74721]:     <video>
Nov 02 23:30:29 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:30:29 user nova-compute[74721]:     </video>
Nov 02 23:30:29 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:30:29 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:30:29 user nova-compute[74721]:     </rng>
Nov 02 23:30:29 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:30:29 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:30:29 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:30:29 user nova-compute[74721]:     </memballoon>
Nov 02 23:30:29 user nova-compute[74721]:   </devices>
Nov 02 23:30:29 user nova-compute[74721]: </domain>
Nov 02 23:30:29 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1901706543',display_name='tempest-TestVolumeBootPattern-server-1901706543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1901706543',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pq54m0yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:30:04Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG os_vif [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ee1cbff-9f22-5780-967e-3074407ca4c6', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1f5ca79-97, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1f5ca79-97, col_values=(('qos', UUID('c900b86e-d368-4673-9413-eb55b7caf75d')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1f5ca79-97, col_values=(('external_ids', {'iface-id': 'b1f5ca79-972d-4df3-8b4b-1cee04d5ae85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:35:b0', 'vm-uuid': '8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:29 user nova-compute[74721]: INFO os_vif [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97')
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:30:29 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:fb:35:b0, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] No waiting events found dispatching network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:30 user nova-compute[74721]: WARNING nova.compute.manager [req-4c0ba248-3282-48d2-bf87-9412b274d935 req-14ef370c-2cd4-4622-9902-849b5f3b14f8 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received unexpected event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 for instance with vm_state building and task_state spawning.
Nov 02 23:30:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:30:32 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Instance spawned successfully.
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:30:32 user nova-compute[74721]: INFO nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:32 user nova-compute[74721]: DEBUG nova.compute.manager [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] No waiting events found dispatching network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:30:32 user nova-compute[74721]: WARNING nova.compute.manager [req-52a087d6-2f2d-4022-95c7-e866e0a6cf09 req-802c1db9-ff9c-42d0-be31-b45373c728a6 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received unexpected event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 for instance with vm_state building and task_state spawning.
Nov 02 23:30:32 user nova-compute[74721]: INFO nova.compute.manager [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Took 29.82 seconds to build instance.
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-77d8182d-c7be-4b15-8f42-37f6437198c4 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.953s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:33 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 is timed out.
Nov 02 23:30:33 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully detached device vdb from instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 from the live domain config.
Nov 02 23:30:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybQlOhgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:30:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac9363-6e42-40ff-8818-d31dec9377f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:30:33 user nova-compute[74721]: No targets found.
Nov 02 23:30:33 user nova-compute[74721]: iSNS:
Nov 02 23:30:33 user nova-compute[74721]: No targets found.
Nov 02 23:30:33 user nova-compute[74721]: STATIC:
Nov 02 23:30:33 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35
Nov 02 23:30:33 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:30:33 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:30:33 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:30:33 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:30:33 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:30:33 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:30:33 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:30:33 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:30:33 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337
Nov 02 23:30:33 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:30:33 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:30:33 user nova-compute[74721]: FIRMWARE:
Nov 02 23:30:33 user nova-compute[74721]: No targets found.
Nov 02 23:30:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:30:33 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:30:33 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a338a390-a887-42cf-98b5-5269973d2784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a86d9b6-b28b-4e75-9c4f-4c255a67a38c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:30:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf241a8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ecd81-02dd-4acd-96bb-b9ec81e3bf3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9a5bf-77d4-46ab-97b2-5a66dcc56ea1]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5216a-0ebd-4b1f-a201-4bfb305e8044]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4614815d-7530-4f2c-87da-c8402c6ef8c7]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247e1d1-04c3-40a6-8c07-c629a36be4e6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b61ec-ce7f-4805-a286-764dec2311b1]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260]
Nov 02 23:30:33 user nova-compute[74721]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337, portal: 172.16.0.220,3260] successful.
Nov 02 23:30:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd81943a-87c1-4753-a007-a47c22742337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e391b42-41c9-405f-9c01-dbdac2518160]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== disconnect_volume: return (373ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:30:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-926d7201-24a5-459e-a39f-b0f91410e1f0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.062s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:30:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:30:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:30:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:30:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:30:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:30:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:01 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:02 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:03 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:31:03 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:31:03 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8398MB free_disk=24.867794036865234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:03 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:31:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:31:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:31:13 user nova-compute[74721]: INFO nova.compute.manager [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] instance snapshotting
Nov 02 23:31:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Beginning live snapshot process
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json -f qcow2 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12.delta 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:14 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12.delta 1073741824" returned: 0 in 0.051s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:14 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 23:31:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:31:15 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74721) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 23:31:15 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 23:31:15 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:31:15 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12.delta /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:16 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12.delta /opt/stack/data/nova/instances/snapshots/tmphb3cctxm/ca62e7d8dbaf4bd3ab4ab725d45b8d12" returned: 0 in 0.447s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:16 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Snapshot extracted, beginning image upload
Nov 02 23:31:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Snapshot image upload complete
Nov 02 23:31:18 user nova-compute[74721]: INFO nova.compute.manager [None req-46ae1d3f-bb38-4c52-919a-7b03a6912e8e tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Took 5.13 seconds to snapshot the instance on the hypervisor.
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Verify base images {{(pid=74721) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74721) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Image id bf81f74d-ac5b-4b08-8444-661e551c1f11 yields fingerprint 04bb4d08328a96c91fe87ae379bb4017af42524e {{(pid=74721) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 23:31:18 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] image bf81f74d-ac5b-4b08-8444-661e551c1f11 at (/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e): checking
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] image bf81f74d-ac5b-4b08-8444-661e551c1f11 at (/opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e): image is in use {{(pid=74721) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 90a900a7-735a-4be9-a265-8c26b703214f is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 90a900a7-735a-4be9-a265-8c26b703214f has a disk file {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 23:31:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f is backed by 04bb4d08328a96c91fe87ae379bb4017af42524e {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 has a disk file {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 is backed by 04bb4d08328a96c91fe87ae379bb4017af42524e {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] b120c949-845c-47ad-a10b-602434960dae is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 3d3e49c8-ef70-4858-bf44-5d0b6be0816c is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 3d3e49c8-ef70-4858-bf44-5d0b6be0816c has a disk file {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c is backed by 04bb4d08328a96c91fe87ae379bb4017af42524e {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce is a valid instance name {{(pid=74721) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1
Nov 02 23:31:19 user nova-compute[74721]: WARNING nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Unknown base file: /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Active base files: /opt/stack/data/nova/instances/_base/04bb4d08328a96c91fe87ae379bb4017af42524e
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Removable base files: /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79 /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03 /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6 /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45 /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11 /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1 /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ed37f670db4a9ccf9a5263ffa5562a81018ff87b
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/283c967ef7e71a928f1a8d119be2c1e208e12a79
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c75aacbe33fc3a2c6e81da4218a44bf1af541c03
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/294d6a8e6d2f34018169c6b6968606fdc69505f6
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d74b863f3f72b6dc230b14f5cd90709003236f45
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5147cb59264add6857dc3ef49838b9dc85ba6a11
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11c5cd4df0e96bfb6eaf0b93ff5c9e134cc7fff1
Nov 02 23:31:19 user nova-compute[74721]: INFO nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6d51a1f7c03cc731d742a96dbea7bfa62f9f0073
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Verification complete {{(pid=74721) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Verify swap images {{(pid=74721) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 02 23:31:19 user nova-compute[74721]: DEBUG nova.virt.libvirt.imagecache [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Verify ephemeral images {{(pid=74721) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:31:21 user nova-compute[74721]: INFO nova.compute.claims [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Claim successful on node user
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:31:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.policy [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '736f23e5c24647bbb029d29a6f48cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b013767d15ba4080b709cfd55431494b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:31:21 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Creating image(s)
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "/opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "/opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "d369f677652edd39942c449b2ba036ef9407fdcc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:21 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "d369f677652edd39942c449b2ba036ef9407fdcc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:22 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.part --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:22 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Successfully created port: f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG nova.virt.images [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] 91a22f88-10a2-462d-946d-bdab93e824f8 was qcow2, converting to raw {{(pid=74721) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG nova.privsep.utils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74721) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.part /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.converted {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.part /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.converted" returned: 0 in 0.717s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.converted --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Successfully updated port: f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:31:23 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "d369f677652edd39942c449b2ba036ef9407fdcc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.027s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing instance network info cache due to event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] Acquiring lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] Acquired lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing network info cache for port f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "d369f677652edd39942c449b2ba036ef9407fdcc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "d369f677652edd39942c449b2ba036ef9407fdcc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-16ce36fc-41e6-40b4-9155-3bd3aaee405b req-b7e8c3db-96d2-4d8e-aa6e-d6c4e95cb376 service nova] Releasing lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquired lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json" returned: 0 in 0.174s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc,backing_fmt=raw /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk 1073741824 {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc,backing_fmt=raw /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk 1073741824" returned: 0 in 0.047s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "d369f677652edd39942c449b2ba036ef9407fdcc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d369f677652edd39942c449b2ba036ef9407fdcc --force-share --output=json" returned: 0 in 0.187s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Created local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Ensure instance console log exists: /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.neutron [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating instance_info_cache with network_info: [{"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Releasing lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance network_info: |[{"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Start _get_guest_xml network_info=[{"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c750d486edccb73d9e850ca59c92091',container_format='bare',created_at=2023-11-02T23:31:13Z,direct_url=<?>,disk_format='qcow2',id=91a22f88-10a2-462d-946d-bdab93e824f8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2026311783',owner='b013767d15ba4080b709cfd55431494b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:31:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '91a22f88-10a2-462d-946d-bdab93e824f8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:31:24 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:31:24 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c750d486edccb73d9e850ca59c92091',container_format='bare',created_at=2023-11-02T23:31:13Z,direct_url=<?>,disk_format='qcow2',id=91a22f88-10a2-462d-946d-bdab93e824f8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2026311783',owner='b013767d15ba4080b709cfd55431494b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T23:31:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-658815033',display_name='tempest-TestStampPattern-server-658815033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-658815033',id=51,image_ref='91a22f88-10a2-462d-946d-bdab93e824f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-na5pyf7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='814f0703-fa5a-4a44-8dfb-91a9b9dcf091',image_min_disk='1',image_min_ram='0',image_owner_id='b013767d15ba4080b709cfd55431494b',image_owner_project_name='tempest-TestStampPattern-573014398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-573014398-project-member',image_user_id='736f23e5c24647bbb029d29a6f48cf38',network_allocated='True',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:31:22Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=6cc0527e-558f-4f75-b5a9-99e34bb85630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:31:24 user nova-compute[74721]:   <uuid>6cc0527e-558f-4f75-b5a9-99e34bb85630</uuid>
Nov 02 23:31:24 user nova-compute[74721]:   <name>instance-00000033</name>
Nov 02 23:31:24 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:31:24 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:31:24 user nova-compute[74721]:   <metadata>
Nov 02 23:31:24 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:31:24 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:name>tempest-TestStampPattern-server-658815033</nova:name>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:31:24</nova:creationTime>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:31:24 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:31:24 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:owner>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:user uuid="736f23e5c24647bbb029d29a6f48cf38">tempest-TestStampPattern-573014398-project-member</nova:user>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:project uuid="b013767d15ba4080b709cfd55431494b">tempest-TestStampPattern-573014398</nova:project>
Nov 02 23:31:24 user nova-compute[74721]:       </nova:owner>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:root type="image" uuid="91a22f88-10a2-462d-946d-bdab93e824f8"/>
Nov 02 23:31:24 user nova-compute[74721]:       <nova:ports>
Nov 02 23:31:24 user nova-compute[74721]:         <nova:port uuid="f6aa76b1-6851-4a1f-8aff-2bd1809856c6">
Nov 02 23:31:24 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 23:31:24 user nova-compute[74721]:         </nova:port>
Nov 02 23:31:24 user nova-compute[74721]:       </nova:ports>
Nov 02 23:31:24 user nova-compute[74721]:     </nova:instance>
Nov 02 23:31:24 user nova-compute[74721]:   </metadata>
Nov 02 23:31:24 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:31:24 user nova-compute[74721]:     <system>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="serial">6cc0527e-558f-4f75-b5a9-99e34bb85630</entry>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="uuid">6cc0527e-558f-4f75-b5a9-99e34bb85630</entry>
Nov 02 23:31:24 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:31:24 user nova-compute[74721]:     </system>
Nov 02 23:31:24 user nova-compute[74721]:   </sysinfo>
Nov 02 23:31:24 user nova-compute[74721]:   <os>
Nov 02 23:31:24 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:31:24 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:31:24 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:31:24 user nova-compute[74721]:   </os>
Nov 02 23:31:24 user nova-compute[74721]:   <features>
Nov 02 23:31:24 user nova-compute[74721]:     <acpi/>
Nov 02 23:31:24 user nova-compute[74721]:     <apic/>
Nov 02 23:31:24 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:31:24 user nova-compute[74721]:   </features>
Nov 02 23:31:24 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:31:24 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:31:24 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:31:24 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:31:24 user nova-compute[74721]:   </clock>
Nov 02 23:31:24 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:31:24 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:31:24 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:31:24 user nova-compute[74721]:   </cpu>
Nov 02 23:31:24 user nova-compute[74721]:   <devices>
Nov 02 23:31:24 user nova-compute[74721]:     <disk type="file" device="disk">
Nov 02 23:31:24 user nova-compute[74721]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 23:31:24 user nova-compute[74721]:       <source file="/opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk"/>
Nov 02 23:31:24 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:31:24 user nova-compute[74721]:     </disk>
Nov 02 23:31:24 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:31:24 user nova-compute[74721]:       <mac address="fa:16:3e:a1:60:d8"/>
Nov 02 23:31:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:31:24 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:31:24 user nova-compute[74721]:       <target dev="tapf6aa76b1-68"/>
Nov 02 23:31:24 user nova-compute[74721]:     </interface>
Nov 02 23:31:24 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:31:24 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/console.log" append="off"/>
Nov 02 23:31:24 user nova-compute[74721]:     </serial>
Nov 02 23:31:24 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:31:24 user nova-compute[74721]:     <video>
Nov 02 23:31:24 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:31:24 user nova-compute[74721]:     </video>
Nov 02 23:31:24 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:31:24 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:31:24 user nova-compute[74721]:     </rng>
Nov 02 23:31:24 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:31:24 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:31:24 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:31:24 user nova-compute[74721]:     </memballoon>
Nov 02 23:31:24 user nova-compute[74721]:   </devices>
Nov 02 23:31:24 user nova-compute[74721]: </domain>
Nov 02 23:31:24 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-658815033',display_name='tempest-TestStampPattern-server-658815033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-658815033',id=51,image_ref='91a22f88-10a2-462d-946d-bdab93e824f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-na5pyf7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='814f0703-fa5a-4a44-8dfb-91a9b9dcf091',image_min_disk='1',image_min_ram='0',image_owner_id='b013767d15ba4080b709cfd55431494b',image_owner_project_name='tempest-TestStampPattern-573014398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-573014398-project-member',image_user_id='736f23e5c24647bbb029d29a6f48cf38',network_allocated='True',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:31:22Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=6cc0527e-558f-4f75-b5a9-99e34bb85630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG os_vif [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3f1bbd-d56c-52e3-b3aa-088fb2329422', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6aa76b1-68, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6aa76b1-68, col_values=(('qos', UUID('fbc9e8b1-6f9e-4747-9eb9-b1189a400e17')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6aa76b1-68, col_values=(('external_ids', {'iface-id': 'f6aa76b1-6851-4a1f-8aff-2bd1809856c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:60:d8', 'vm-uuid': '6cc0527e-558f-4f75-b5a9-99e34bb85630'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:24 user nova-compute[74721]: INFO os_vif [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68')
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:31:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No VIF found with MAC fa:16:3e:a1:60:d8, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] No waiting events found dispatching network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:31:26 user nova-compute[74721]: WARNING nova.compute.manager [req-babd5bd0-5b52-4ee3-9e95-85d721824ff7 req-6760334a-d78f-40ee-a8a8-708b2e7e05f7 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received unexpected event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 for instance with vm_state building and task_state spawning.
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] No waiting events found dispatching network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:31:28 user nova-compute[74721]: WARNING nova.compute.manager [req-a8317c39-21c3-41eb-b857-0d37bc69686a req-fe2a9b2d-9e1d-422e-89e6-2c8aa6780783 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received unexpected event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 for instance with vm_state building and task_state spawning.
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:31:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance spawned successfully.
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:31:28 user nova-compute[74721]: INFO nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 02 23:31:28 user nova-compute[74721]: DEBUG nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:31:28 user nova-compute[74721]: INFO nova.compute.manager [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Took 7.19 seconds to build instance.
Nov 02 23:31:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-b6e27521-418f-42f2-85ae-bcd33e8617c0 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.289s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:31:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:31:50 user nova-compute[74721]: DEBUG nova.objects.instance [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lazy-loading 'info_cache' on Instance uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:31:51 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [{"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:31:51 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-3d3e49c8-ef70-4858-bf44-5d0b6be0816c" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:31:51 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:31:51 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.compute.manager [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing instance network info cache due to event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] Acquiring lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] Acquired lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updated VIF entry in instance network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.network.neutron [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating instance_info_cache with network_info: [{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1dffbd44-b70c-4668-b810-70f4009afb26 req-5963da8c-9eaa-44c4-9840-a4f1da0726ad service nova] Releasing lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:31:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:31:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:31:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:01 user nova-compute[74721]: INFO nova.compute.manager [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Unrescuing
Nov 02 23:32:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquired lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG nova.network.neutron [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG nova.network.neutron [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating instance_info_cache with network_info: [{"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Releasing lock "refresh_cache-1bbfc456-48bd-42a1-ad15-d78cbc7973f1" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG nova.objects.instance [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'flavor' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG nova.compute.manager [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:02 user nova-compute[74721]: WARNING nova.compute.manager [req-aca85e20-f17c-4af8-bc4d-cf84bb367ad9 req-35a4b9fb-7ed0-47c0-9a81-d789e2bac640 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:32:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:02 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance destroyed successfully.
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:02 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:32:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:04 user nova-compute[74721]: WARNING nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:04 user nova-compute[74721]: WARNING nova.compute.manager [req-ae0b54e8-272b-4f4a-bc5a-94ebf20d6a13 req-c06d5ada-1b52-45a3-b7f2-3bdd7c9ea6c7 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:04 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.manager [None req-329ec6dc-3894-4026-93dc-73fe5eb65310 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:32:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:32:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=24.720970153808594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:06 user nova-compute[74721]: WARNING nova.compute.manager [req-237bf9a3-379b-449d-907d-484d0ba9a8f1 req-aadc728d-383e-4c0b-b2e0-f8cb997bc54f service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state rescued and task_state unrescuing.
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:32:06 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.141s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:07 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:32:09 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:12 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Starting instance... {{(pid=74721) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74721) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 23:32:13 user nova-compute[74721]: INFO nova.compute.claims [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Claim successful on node user
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Start building networks asynchronously for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Allocating IP information in the background. {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] allocate_for_instance() {{(pid=74721) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 23:32:13 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Start building block device mappings for instance. {{(pid=74721) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.policy [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0d084b45744960ad586bc68bfd81ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6fd03271be4da382c041846492b561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74721) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 23:32:13 user nova-compute[74721]: INFO nova.virt.block_device [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Booting with volume 4f0117ec-c367-4014-88f8-435de1725bdd at /dev/vda
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[91366632-b8c2-457c-a8af-94ba011c24aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08977f-0a21-4562-997b-eb0cf19d5844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0c695c-65c1-4c8c-a2f5-fd6fd9df025c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c6eac-7abe-4bab-9124-bab0084ecc05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:32:13 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:32:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee14ea-07e1-4b7d-b165-7ee4ca90350d]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:32:13 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating existing volume attachment record: bf110d9a-0b1b-4b96-a4b6-d14fa0028b30 {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Successfully created port: 633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Successfully updated port: 633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquired lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:32:14 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Building network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.compute.manager [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing instance network info cache due to event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] Acquiring lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Instance cache missing network info. {{(pid=74721) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.network.neutron [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Releasing lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Instance network_info: |[{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74721) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] Acquired lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updated VIF entry in instance network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG nova.network.neutron [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:32:15 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cf4c469e-ce22-419f-a039-8a61aef9dc58 req-83427040-4dbc-4cb9-9782-f16ccae5363b service nova] Releasing lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:32:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:32:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Start spawning the instance on the hypervisor. {{(pid=74721) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Creating instance directory {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 23:32:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Creating image(s)
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Did not create local disks {{(pid=74721) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Ensure instance console log exists: /opt/stack/data/nova/instances/2c593e2b-dc98-4266-b20a-9bceceb09ce3/console.log {{(pid=74721) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Start _get_guest_xml network_info=[{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'bf110d9a-0b1b-4b96-a4b6-d14fa0028b30', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFfhPGkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c593e2b-dc98-4266-b20a-9bceceb09ce3', 'attached_at': '', 'detached_at': '', 'volume_id': '4f0117ec-c367-4014-88f8-435de1725bdd', 'serial': '4f0117ec-c367-4014-88f8-435de1725bdd'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 23:32:34 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:32:34 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller missing on host. {{(pid=74721) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.host [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU controller found on host. {{(pid=74721) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74721) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T22:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image limits 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flavor pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Image pref 0:0:0 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Got 1 possible topologies {{(pid=74721) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.hardware [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74721) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFfhPGkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:32:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:32:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:32:34 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6040606-b12e-48c4-bdfe-b08e914d50ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:32:34 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648afdf-bdf4-4a42-b3ea-109432a099e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd] added
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[25134fe8-102c-4be1-b048-33347aa25dcd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ba0dd-a54b-4f34-8349-d2166f4882b8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFfhPGkb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFfhPGkb" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eab6bd-e9bd-4bc2-88e3-7dfb7740d355]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFfhPGkb'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8de1ea2-6f32-4ff4-bfcd-54c187de57a1]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1eb640-a56c-4924-972d-db5ba0184280]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e9ef2-0234-44e3-ad97-40d65d876314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260]
Nov 02 23:32:34 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260] successful.
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a345d17-058d-4528-9243-3eec9a384ae8]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[700534e1-32a3-483a-b35b-9e51c935ca37]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:32:34 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:32:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8c3e9a-66b0-4cb9-9987-7cc7aaec2560]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFfhPGkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:32:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26436306636373731', 'path': '/dev/sde'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436306636373731', 'path': '/dev/sde'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1088357516',display_name='tempest-TestVolumeBootPattern-server-1088357516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1088357516',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-euc0ea8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:32:14Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=2c593e2b-dc98-4266-b20a-9bceceb09ce3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74721) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.objects.instance [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c593e2b-dc98-4266-b20a-9bceceb09ce3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 23:32:35 user nova-compute[74721]:   <uuid>2c593e2b-dc98-4266-b20a-9bceceb09ce3</uuid>
Nov 02 23:32:35 user nova-compute[74721]:   <name>instance-00000034</name>
Nov 02 23:32:35 user nova-compute[74721]:   <memory>524288</memory>
Nov 02 23:32:35 user nova-compute[74721]:   <vcpu>1</vcpu>
Nov 02 23:32:35 user nova-compute[74721]:   <metadata>
Nov 02 23:32:35 user nova-compute[74721]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 23:32:35 user nova-compute[74721]:       <nova:package version="0.0.0"/>
Nov 02 23:32:35 user nova-compute[74721]:       <nova:name>tempest-TestVolumeBootPattern-server-1088357516</nova:name>
Nov 02 23:32:35 user nova-compute[74721]:       <nova:creationTime>2023-11-02 23:32:34</nova:creationTime>
Nov 02 23:32:35 user nova-compute[74721]:       <nova:flavor name="m1.tiny">
Nov 02 23:32:35 user nova-compute[74721]:         <nova:memory>512</nova:memory>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:disk>1</nova:disk>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:swap>0</nova:swap>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:vcpus>1</nova:vcpus>
Nov 02 23:32:35 user nova-compute[74721]:       </nova:flavor>
Nov 02 23:32:35 user nova-compute[74721]:       <nova:owner>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:user uuid="3d0d084b45744960ad586bc68bfd81ab">tempest-TestVolumeBootPattern-1714088517-project-member</nova:user>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:project uuid="5e6fd03271be4da382c041846492b561">tempest-TestVolumeBootPattern-1714088517</nova:project>
Nov 02 23:32:35 user nova-compute[74721]:       </nova:owner>
Nov 02 23:32:35 user nova-compute[74721]:       <nova:ports>
Nov 02 23:32:35 user nova-compute[74721]:         <nova:port uuid="633605f9-c10f-4f92-8a84-cfb1dc00dc67">
Nov 02 23:32:35 user nova-compute[74721]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 23:32:35 user nova-compute[74721]:         </nova:port>
Nov 02 23:32:35 user nova-compute[74721]:       </nova:ports>
Nov 02 23:32:35 user nova-compute[74721]:     </nova:instance>
Nov 02 23:32:35 user nova-compute[74721]:   </metadata>
Nov 02 23:32:35 user nova-compute[74721]:   <sysinfo type="smbios">
Nov 02 23:32:35 user nova-compute[74721]:     <system>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="product">OpenStack Nova</entry>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="version">0.0.0</entry>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="serial">2c593e2b-dc98-4266-b20a-9bceceb09ce3</entry>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="uuid">2c593e2b-dc98-4266-b20a-9bceceb09ce3</entry>
Nov 02 23:32:35 user nova-compute[74721]:       <entry name="family">Virtual Machine</entry>
Nov 02 23:32:35 user nova-compute[74721]:     </system>
Nov 02 23:32:35 user nova-compute[74721]:   </sysinfo>
Nov 02 23:32:35 user nova-compute[74721]:   <os>
Nov 02 23:32:35 user nova-compute[74721]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 23:32:35 user nova-compute[74721]:     <boot dev="hd"/>
Nov 02 23:32:35 user nova-compute[74721]:     <smbios mode="sysinfo"/>
Nov 02 23:32:35 user nova-compute[74721]:   </os>
Nov 02 23:32:35 user nova-compute[74721]:   <features>
Nov 02 23:32:35 user nova-compute[74721]:     <acpi/>
Nov 02 23:32:35 user nova-compute[74721]:     <apic/>
Nov 02 23:32:35 user nova-compute[74721]:     <vmcoreinfo/>
Nov 02 23:32:35 user nova-compute[74721]:   </features>
Nov 02 23:32:35 user nova-compute[74721]:   <clock offset="utc">
Nov 02 23:32:35 user nova-compute[74721]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 23:32:35 user nova-compute[74721]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 23:32:35 user nova-compute[74721]:     <timer name="hpet" present="no"/>
Nov 02 23:32:35 user nova-compute[74721]:   </clock>
Nov 02 23:32:35 user nova-compute[74721]:   <cpu mode="custom" match="exact">
Nov 02 23:32:35 user nova-compute[74721]:     <model>Nehalem</model>
Nov 02 23:32:35 user nova-compute[74721]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 23:32:35 user nova-compute[74721]:   </cpu>
Nov 02 23:32:35 user nova-compute[74721]:   <devices>
Nov 02 23:32:35 user nova-compute[74721]:     <disk type="block" device="disk">
Nov 02 23:32:35 user nova-compute[74721]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:32:35 user nova-compute[74721]:       <source dev="/dev/sde"/>
Nov 02 23:32:35 user nova-compute[74721]:       <target dev="vda" bus="virtio"/>
Nov 02 23:32:35 user nova-compute[74721]:       <serial>4f0117ec-c367-4014-88f8-435de1725bdd</serial>
Nov 02 23:32:35 user nova-compute[74721]:     </disk>
Nov 02 23:32:35 user nova-compute[74721]:     <interface type="ethernet">
Nov 02 23:32:35 user nova-compute[74721]:       <mac address="fa:16:3e:a6:15:33"/>
Nov 02 23:32:35 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:32:35 user nova-compute[74721]:       <mtu size="1442"/>
Nov 02 23:32:35 user nova-compute[74721]:       <target dev="tap633605f9-c1"/>
Nov 02 23:32:35 user nova-compute[74721]:     </interface>
Nov 02 23:32:35 user nova-compute[74721]:     <serial type="pty">
Nov 02 23:32:35 user nova-compute[74721]:       <log file="/opt/stack/data/nova/instances/2c593e2b-dc98-4266-b20a-9bceceb09ce3/console.log" append="off"/>
Nov 02 23:32:35 user nova-compute[74721]:     </serial>
Nov 02 23:32:35 user nova-compute[74721]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 23:32:35 user nova-compute[74721]:     <video>
Nov 02 23:32:35 user nova-compute[74721]:       <model type="virtio"/>
Nov 02 23:32:35 user nova-compute[74721]:     </video>
Nov 02 23:32:35 user nova-compute[74721]:     <rng model="virtio">
Nov 02 23:32:35 user nova-compute[74721]:       <backend model="random">/dev/urandom</backend>
Nov 02 23:32:35 user nova-compute[74721]:     </rng>
Nov 02 23:32:35 user nova-compute[74721]:     <controller type="usb" index="0" model="none"/>
Nov 02 23:32:35 user nova-compute[74721]:     <memballoon model="virtio">
Nov 02 23:32:35 user nova-compute[74721]:       <stats period="10"/>
Nov 02 23:32:35 user nova-compute[74721]:     </memballoon>
Nov 02 23:32:35 user nova-compute[74721]:   </devices>
Nov 02 23:32:35 user nova-compute[74721]: </domain>
Nov 02 23:32:35 user nova-compute[74721]:  {{(pid=74721) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1088357516',display_name='tempest-TestVolumeBootPattern-server-1088357516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1088357516',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-euc0ea8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T23:32:14Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=2c593e2b-dc98-4266-b20a-9bceceb09ce3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG os_vif [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1') {{(pid=74721) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '737ae547-5d02-537d-bc1c-065fec904b5c', '_type': 'linux-noop'}}, row=False) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap633605f9-c1, may_exist=True, interface_attrs={}) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap633605f9-c1, col_values=(('qos', UUID('296b7fb6-87d4-423b-abda-5044cb2429e1')),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap633605f9-c1, col_values=(('external_ids', {'iface-id': '633605f9-c10f-4f92-8a84-cfb1dc00dc67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:15:33', 'vm-uuid': '2c593e2b-dc98-4266-b20a-9bceceb09ce3'}),), if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:35 user nova-compute[74721]: INFO os_vif [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1')
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:32:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] No VIF found with MAC fa:16:3e:a6:15:33, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:32:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG nova.compute.manager [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] No waiting events found dispatching network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:37 user nova-compute[74721]: WARNING nova.compute.manager [req-18eb6058-0f08-434a-9a7c-11c6217ec010 req-228be584-a3ff-456a-bf54-a6a528fe23fa service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received unexpected event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 for instance with vm_state building and task_state spawning.
Nov 02 23:32:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:37 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Instance event wait completed in 0 seconds for  {{(pid=74721) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Guest created on hypervisor {{(pid=74721) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 23:32:38 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Instance spawned successfully.
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_cdrom_bus of ide {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_disk_bus of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_input_bus of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_pointer_model of None {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_video_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:38 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Found default for hw_vif_model of virtio {{(pid=74721) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 23:32:39 user nova-compute[74721]: INFO nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 02 23:32:39 user nova-compute[74721]: DEBUG nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Checking state {{(pid=74721) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 23:32:39 user nova-compute[74721]: INFO nova.compute.manager [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Took 25.90 seconds to build instance.
Nov 02 23:32:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-88fdb709-661a-4d2c-be20-9a0039dcadca tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.986s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:32:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:39 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:39 user nova-compute[74721]: DEBUG nova.compute.manager [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] No waiting events found dispatching network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:32:39 user nova-compute[74721]: WARNING nova.compute.manager [req-ef951182-1569-4950-89e6-cf8f78219052 req-5dfa0cd6-9e16-475d-b0f8-3cc2379d216a service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received unexpected event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 for instance with vm_state active and task_state None.
Nov 02 23:32:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_power_states {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 90a900a7-735a-4be9-a265-8c26b703214f {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Triggering sync for uuid 2c593e2b-dc98-4266-b20a-9bceceb09ce3 {{(pid=74721) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "b120c949-845c-47ad-a10b-602434960dae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "90a900a7-735a-4be9-a265-8c26b703214f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "b120c949-845c-47ad-a10b-602434960dae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "90a900a7-735a-4be9-a265-8c26b703214f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:32:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:49 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:49 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:32:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:32:49 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:32:49 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [{"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-b120c949-845c-47ad-a10b-602434960dae" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: b120c949-845c-47ad-a10b-602434960dae] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:32:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:55 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:32:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:32:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:32:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:00 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:03 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:04 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:05 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:33:06 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:33:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8181MB free_disk=24.712066650390625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 2c593e2b-dc98-4266-b20a-9bceceb09ce3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:33:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:10 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:33:12 user nova-compute[74721]: DEBUG nova.compute.manager [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing instance network info cache due to event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:33:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] Acquiring lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:33:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] Acquired lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:33:12 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing network info cache for port f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updated VIF entry in instance network info cache for port f6aa76b1-6851-4a1f-8aff-2bd1809856c6. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG nova.network.neutron [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating instance_info_cache with network_info: [{"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-d6c9df96-0036-4092-9fd5-d3eb26ae595b req-55e40497-d905-4352-b004-c1e77ac1eaa1 service nova] Releasing lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:13 user nova-compute[74721]: INFO nova.compute.manager [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Attaching volume f28bc298-eb1d-4262-ac56-08fc2eaf4f5e to /dev/vdb
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe74ec-b299-4548-b833-0248af1dd8b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d8ff28aa5a4\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dcd381-fc9d-4ca9-a51e-105138327eb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5002ae7a-c54a-4bbe-b085-a5547ed94165]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5947b1-cedb-4b1b-8d35-265e37b5b29d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Running cmd (subprocess): nvme version {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] 'nvme version' failed. Not Retrying. {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] nvme not present on system {{(pid=74721) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 23:33:13 user nova-compute[74721]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 23:33:13 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445f61a-3211-4729-a89a-e84492f30efc]: (4, '') {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74721) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.lightos [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] LIGHTOS: no hostnqn found. {{(pid=74721) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG os_brick.utils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d8ff28aa5a4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:33:13 user nova-compute[74721]: DEBUG nova.virt.block_device [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating existing volume attachment record: 02dfa5f1-0954-46a4-87e6-567a18b5b18e {{(pid=74721) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 23:33:15 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:33:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:20 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:30 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:31 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Calling os-brick to attach iSCSI Volume {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mietUArv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:33:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:33:33 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:33:33 user nova-compute[74721]: INFO os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebec8478-f005-42de-8559-296c439bd0ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 23:33:33 user nova-compute[74721]:  {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e104ef-4984-4921-b824-dcdfb8d7912b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e] added\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e] added
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[80590671-614b-42d7-9de3-ef89a12fb722]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d916828-cd27-4a54-93e3-0a221f374024]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mietUArv {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mietUArv" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc38f4-8ee4-4880-aebf-baed1951a3e6]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mietUArv'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d2fe8-ec4e-4766-bbe6-98a855043095]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d5de4-1e61-408b-aa6c-7a2ced94b41c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --login {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2dd85-74d5-4678-b026-c7f1ba87fce1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260]
Nov 02 23:33:33 user nova-compute[74721]: Login to [iface: default, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260] successful.
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de947d69-563c-4f9f-be9d-a9cb2f88e89c]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0923edf0-c08f-4764-97c4-461b332fb931]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:33 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:33 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Connected to 172.16.0.220:3260 {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] HCTL ('37', '-', '-', 0) found on session 60 with lun 0 {{(pid=74721) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74721) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312b667-b30f-4695-b3fa-67b851086cbc]: (4, ('- - 0', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:33 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching for a device in session 60 and hctl ['37', '*', '*', 0] yield: None {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Searching for a device in session 60 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74721) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mietUArv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74721) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23963653138353832', 'path': '/dev/sdf'} {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963653138353832', 'path': '/dev/sdf'} {{(pid=74721) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:33:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 23:33:34 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:33:34 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:33:34 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:33:34 user nova-compute[74721]:   <serial>f28bc298-eb1d-4262-ac56-08fc2eaf4f5e</serial>
Nov 02 23:33:34 user nova-compute[74721]: </disk>
Nov 02 23:33:34 user nova-compute[74721]:  {{(pid=74721) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 23:33:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vda, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:33:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74721) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 23:33:35 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] No VIF found with MAC fa:16:3e:a1:60:d8, not building metadata {{(pid=74721) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 23:33:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-c685bce1-dcb8-41f9-ac40-40bccfd52e47 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.659s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:35 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:36 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:37 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:37 user nova-compute[74721]: INFO nova.compute.manager [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Detaching volume f28bc298-eb1d-4262-ac56-08fc2eaf4f5e
Nov 02 23:33:37 user nova-compute[74721]: INFO nova.virt.block_device [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Attempting to driver detach volume f28bc298-eb1d-4262-ac56-08fc2eaf4f5e from mountpoint /dev/vdb
Nov 02 23:33:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Attempting to detach device vdb from instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 from the persistent domain config. {{(pid=74721) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 23:33:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:33:37 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:33:37 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:33:37 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:33:37 user nova-compute[74721]:   <serial>f28bc298-eb1d-4262-ac56-08fc2eaf4f5e</serial>
Nov 02 23:33:37 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:33:37 user nova-compute[74721]: </disk>
Nov 02 23:33:37 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:33:37 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully detached device vdb from instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 from the persistent domain config.
Nov 02 23:33:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 from the live domain config. {{(pid=74721) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 23:33:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.guest [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 23:33:37 user nova-compute[74721]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 23:33:37 user nova-compute[74721]:   <source dev="/dev/sdf"/>
Nov 02 23:33:37 user nova-compute[74721]:   <target dev="vdb" bus="virtio"/>
Nov 02 23:33:37 user nova-compute[74721]:   <serial>f28bc298-eb1d-4262-ac56-08fc2eaf4f5e</serial>
Nov 02 23:33:37 user nova-compute[74721]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 23:33:37 user nova-compute[74721]: </disk>
Nov 02 23:33:37 user nova-compute[74721]:  {{(pid=74721) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 23:33:37 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 23:33:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:45 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:50 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:52 user nova-compute[74721]: INFO nova.compute.manager [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Terminating instance
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [req-1082b3b3-383f-47e9-a5dd-7317bf865109 req-f25ffa83-7c2e-4e82-9d79-20948bb180bc service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-unplugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Instance destroyed successfully.
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.objects.instance [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid 1bbfc456-48bd-42a1-ad15-d78cbc7973f1 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668295238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668295238',id=49,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:30:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-1crpy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:32:06Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=1bbfc456-48bd-42a1-ad15-d78cbc7973f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "address": "fa:16:3e:4a:f8:fd", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ddcc913-9e", "ovs_interfaceid": "3ddcc913-9e6d-43d4-8ac4-66a5515fede7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_vif [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ddcc913-9e, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d85fac9-4369-4e82-acfb-23152162e609) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:52 user nova-compute[74721]: INFO os_vif [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f8:fd,bridge_name='br-int',has_traffic_filtering=True,id=3ddcc913-9e6d-43d4-8ac4-66a5515fede7,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ddcc913-9e')
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXGuOZbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:33:52 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[93722f7c-8ba2-4e76-8335-21f6f323a2e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:33:52 user nova-compute[74721]: No targets found.
Nov 02 23:33:52 user nova-compute[74721]: iSNS:
Nov 02 23:33:52 user nova-compute[74721]: No targets found.
Nov 02 23:33:52 user nova-compute[74721]: STATIC:
Nov 02 23:33:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35
Nov 02 23:33:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd
Nov 02 23:33:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:33:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:33:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:52 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e
Nov 02 23:33:52 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:52 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:52 user nova-compute[74721]: FIRMWARE:
Nov 02 23:33:52 user nova-compute[74721]: No targets found.
Nov 02 23:33:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:33:52 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:33:52 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a2ae3-a41c-4eb0-9fe3-568ae00f34b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [{"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-90a900a7-735a-4be9-a265-8c26b703214f" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3749fc0f-1041-48e9-b4c9-a6591f562bdc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:52 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:52 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf0473eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35'): ({'sdd'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Removing single pathed devices sdd {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd39b6d-3770-4434-82ad-a603645ab142]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12dcd1-8208-4e27-ae2e-9fde08b1a14b]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flushing IO for device /dev/sdd {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:33:52 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdf0d9-9ad7-44d9-a538-8e58a082cd2e]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ded857f-0558-4b5d-9cf9-16b4cb926036]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] SCSI volumes sdd have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23562643031333066', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_58a3aed0', '/dev/disk/by-id/scsi-1SCST_BIO58a3aed0-5bd0130f12a82329') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac3f96-c994-4210-8f1b-76fe4db8c0f0]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43ccfe8-3868-418a-be53-687dc3be1614]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[09885dd7-1720-4be6-956e-bb40763ade4d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260]
Nov 02 23:33:53 user nova-compute[74721]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35, portal: 172.16.0.220,3260] successful.
Nov 02 23:33:53 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be55c2f-2014-486b-835e-58ea83037c35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f1f0c-d29e-49ab-8886-75c52ccec492]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== disconnect_volume: return (339ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:33:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Deleting instance files /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1_del
Nov 02 23:33:53 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Deletion of /opt/stack/data/nova/instances/1bbfc456-48bd-42a1-ad15-d78cbc7973f1_del complete
Nov 02 23:33:53 user nova-compute[74721]: INFO nova.compute.manager [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 02 23:33:53 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:33:53 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:33:53 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Took 0.45 seconds to deallocate network for instance.
Nov 02 23:33:53 user nova-compute[74721]: DEBUG nova.compute.manager [req-0e2c7a07-e5ad-462b-bbcb-bd66dbeb334d req-a2fc9a8e-3028-4494-81d7-5e37b40d0938 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-deleted-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] Acquiring lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG nova.compute.manager [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] No waiting events found dispatching network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:33:54 user nova-compute[74721]: WARNING nova.compute.manager [req-a1bfa316-ca64-4ebd-acba-54cab98295c1 req-63eab9b2-4222-4eeb-92df-ea419bb8e2f8 service nova] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Received unexpected event network-vif-plugged-3ddcc913-9e6d-43d4-8ac4-66a5515fede7 for instance with vm_state active and task_state deleting.
Nov 02 23:33:54 user nova-compute[74721]: INFO nova.compute.manager [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 1bbfc456-48bd-42a1-ad15-d78cbc7973f1] Took 0.85 seconds to detach 1 volumes for instance.
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:54 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Deleted allocations for instance 1bbfc456-48bd-42a1-ad15-d78cbc7973f1
Nov 02 23:33:54 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-72f87b38-cdd7-4217-bc52-edee8fa18f41 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "1bbfc456-48bd-42a1-ad15-d78cbc7973f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.964s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:33:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:33:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:57 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 is timed out.
Nov 02 23:33:57 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully detached device vdb from instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 from the live domain config.
Nov 02 23:33:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mietUArv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:33:57 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9554ed-16fd-469b-877f-75fe3286c549]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:33:57 user nova-compute[74721]: No targets found.
Nov 02 23:33:57 user nova-compute[74721]: iSNS:
Nov 02 23:33:57 user nova-compute[74721]: No targets found.
Nov 02 23:33:57 user nova-compute[74721]: STATIC:
Nov 02 23:33:57 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd
Nov 02 23:33:57 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:57 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:57 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:33:57 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:57 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:57 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:33:57 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:57 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:57 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e
Nov 02 23:33:57 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:33:57 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:33:57 user nova-compute[74721]: FIRMWARE:
Nov 02 23:33:57 user nova-compute[74721]: No targets found.
Nov 02 23:33:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:33:57 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:33:57 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6c29f-5c1d-4c92-9923-fb187e220004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ea55e-a929-4bb6-9dd1-607ca9e14a41]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:33:57 user nova-compute[74721]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e (non-flash)
Nov 02 23:33:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf48b31f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e'): ({'sdf'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Removing single pathed devices sdf {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6468515-ecb0-4e58-964a-b4ed16781350]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbcecea-2ce4-431a-baaa-45d88eff5019]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Flushing IO for device /dev/sdf {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b239afa-c015-4fb3-a36a-ce28b7b5b36f]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab4736-3768-4a5f-80d1-e70536528eef]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] SCSI volumes sdf have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336744e-b84f-471c-8a4c-36397bbf47b9]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfe08f9-b3d8-436e-9554-04bdc9f91e55]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260]
Nov 02 23:33:57 user nova-compute[74721]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e, portal: 172.16.0.220,3260] successful.
Nov 02 23:33:57 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28bc298-eb1d-4262-ac56-08fc2eaf4f5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7aa7c0-7be4-40cd-ad7d-b23a9ead1eac]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] <== disconnect_volume: return (289ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:33:57 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:33:58 user nova-compute[74721]: DEBUG nova.objects.instance [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'flavor' on Instance uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:33:58 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-fbb80522-275e-41ee-8544-9014e86281d4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:34:02 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG nova.compute.manager [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing instance network info cache due to event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] Acquiring lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] Acquired lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG nova.network.neutron [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:04 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updated VIF entry in instance network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.network.neutron [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-894e4f27-69d2-443d-b613-b853d288fb6c req-f378e863-c4bd-46a1-8718-e3bb7fffdf19 service nova] Releasing lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:05 user nova-compute[74721]: INFO nova.compute.manager [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Terminating instance
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.compute.manager [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-unplugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] No waiting events found dispatching network-vif-unplugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:05 user nova-compute[74721]: DEBUG nova.compute.manager [req-91db61fc-e2ab-4cb1-a51a-5bee9ce6184d req-460ec641-a3e8-4e70-8f8e-cb3fb2a8bd57 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-unplugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Instance destroyed successfully.
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.objects.instance [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid 2c593e2b-dc98-4266-b20a-9bceceb09ce3 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1088357516',display_name='tempest-TestVolumeBootPattern-server-1088357516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1088357516',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-euc0ea8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:32:39Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=2c593e2b-dc98-4266-b20a-9bceceb09ce3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_vif [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap633605f9-c1, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=296b7fb6-87d4-423b-abda-5044cb2429e1) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:06 user nova-compute[74721]: INFO os_vif [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:15:33,bridge_name='br-int',has_traffic_filtering=True,id=633605f9-c10f-4f92-8a84-cfb1dc00dc67,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633605f9-c1')
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFfhPGkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:34:06 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1893d6-b094-40b7-9bd7-1333dcf94742]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:34:06 user nova-compute[74721]: No targets found.
Nov 02 23:34:06 user nova-compute[74721]: iSNS:
Nov 02 23:34:06 user nova-compute[74721]: No targets found.
Nov 02 23:34:06 user nova-compute[74721]: STATIC:
Nov 02 23:34:06 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd
Nov 02 23:34:06 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:34:06 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:34:06 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:34:06 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:34:06 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:34:06 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:34:06 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:34:06 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:34:06 user nova-compute[74721]: FIRMWARE:
Nov 02 23:34:06 user nova-compute[74721]: No targets found.
Nov 02 23:34:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:34:06 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:34:06 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea16c18-d805-4f75-b40a-86cbe5059156]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ab788f-62b4-4377-bdff-85df5f7f43b1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:34:06 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:34:06 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:34:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:34:06 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:34:06 user nova-compute[74721]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd (non-flash)
Nov 02 23:34:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf04609fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd'): ({'sde'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sde {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee58cc31-8e68-4e3d-86ef-031289038594]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932844b-2f1f-49cb-a3c3-0b0b25e1b92f]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sde {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe66de1f-7ec3-450e-bbb1-c3dd53fb87dd]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa63db-0ed0-460a-9455-d12b152dc277]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sde have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.compute.manager [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing instance network info cache due to event network-changed-633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] Acquiring lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] Acquired lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.network.neutron [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Refreshing network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade757e-b1a2-4500-be74-ec0b22002948]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485cc23-45a8-4d69-bb22-1b65ba6798f1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260]
Nov 02 23:34:06 user nova-compute[74721]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd, portal: 172.16.0.220,3260] successful.
Nov 02 23:34:06 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f0117ec-c367-4014-88f8-435de1725bdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369c2af-df52-4d0c-ad1c-c667fd4d6b4d]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (355ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:34:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Deleting instance files /opt/stack/data/nova/instances/2c593e2b-dc98-4266-b20a-9bceceb09ce3_del
Nov 02 23:34:06 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Deletion of /opt/stack/data/nova/instances/2c593e2b-dc98-4266-b20a-9bceceb09ce3_del complete
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:06 user nova-compute[74721]: INFO nova.compute.manager [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:34:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-10bdc9c6-6068-4f6e-8582-bd9d37d0d61b req-a4857616-9510-49c1-b495-ae422a56f353 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-deleted-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:07 user nova-compute[74721]: INFO nova.compute.manager [req-10bdc9c6-6068-4f6e-8582-bd9d37d0d61b req-a4857616-9510-49c1-b495-ae422a56f353 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Neutron deleted interface 633605f9-c10f-4f92-8a84-cfb1dc00dc67; detaching it from the instance and deleting it from the info cache
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-10bdc9c6-6068-4f6e-8582-bd9d37d0d61b req-a4857616-9510-49c1-b495-ae422a56f353 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:07 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Took 0.53 seconds to deallocate network for instance.
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.compute.manager [req-10bdc9c6-6068-4f6e-8582-bd9d37d0d61b req-a4857616-9510-49c1-b495-ae422a56f353 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Detach interface failed, port_id=633605f9-c10f-4f92-8a84-cfb1dc00dc67, reason: Instance 2c593e2b-dc98-4266-b20a-9bceceb09ce3 could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updated VIF entry in instance network info cache for port 633605f9-c10f-4f92-8a84-cfb1dc00dc67. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG nova.network.neutron [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Updating instance_info_cache with network_info: [{"id": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "address": "fa:16:3e:a6:15:33", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633605f9-c1", "ovs_interfaceid": "633605f9-c10f-4f92-8a84-cfb1dc00dc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-33a0cdb8-4d07-4b96-89f2-850ea20c3683 req-b23f922b-af36-42b6-9c22-2951205e2c95 service nova] Releasing lock "refresh_cache-2c593e2b-dc98-4266-b20a-9bceceb09ce3" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:07 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] Acquiring lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG nova.compute.manager [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] No waiting events found dispatching network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:08 user nova-compute[74721]: WARNING nova.compute.manager [req-05742acb-320b-4416-b534-f1e3e8e80997 req-94b56c1d-c68c-4344-bc96-3fd84949ae52 service nova] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Received unexpected event network-vif-plugged-633605f9-c10f-4f92-8a84-cfb1dc00dc67 for instance with vm_state active and task_state deleting.
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:08 user nova-compute[74721]: INFO nova.compute.manager [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 2c593e2b-dc98-4266-b20a-9bceceb09ce3] Took 0.86 seconds to detach 1 volumes for instance.
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:34:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:34:08 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:34:08 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=24.710357666015625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.668s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.046s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:09 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance 2c593e2b-dc98-4266-b20a-9bceceb09ce3
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 90a900a7-735a-4be9-a265-8c26b703214f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 6cc0527e-558f-4f75-b5a9-99e34bb85630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-6d245876-1dff-49ef-80ea-97dcf7e1e503 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "2c593e2b-dc98-4266-b20a-9bceceb09ce3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:34:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:26 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG nova.compute.manager [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing instance network info cache due to event network-changed-f6aa76b1-6851-4a1f-8aff-2bd1809856c6. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] Acquiring lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] Acquired lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG nova.network.neutron [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Refreshing network info cache for port f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:27 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:27 user nova-compute[74721]: INFO nova.compute.manager [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Terminating instance
Nov 02 23:34:27 user nova-compute[74721]: DEBUG nova.compute.manager [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-unplugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] No waiting events found dispatching network-vif-unplugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.compute.manager [req-cb7580e4-3f68-4626-8ed5-7928fa5846d0 req-316d4289-e37d-4c9b-b85b-b6764bc84e62 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-unplugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updated VIF entry in instance network info cache for port f6aa76b1-6851-4a1f-8aff-2bd1809856c6. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.network.neutron [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating instance_info_cache with network_info: [{"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-24febc5c-6188-406d-8924-4ede354d73f0 req-18a72018-52f6-4bac-ac5a-107fa3ae561e service nova] Releasing lock "refresh_cache-6cc0527e-558f-4f75-b5a9-99e34bb85630" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:34:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Instance destroyed successfully.
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'resources' on Instance uuid 6cc0527e-558f-4f75-b5a9-99e34bb85630 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-658815033',display_name='tempest-TestStampPattern-server-658815033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-658815033',id=51,image_ref='91a22f88-10a2-462d-946d-bdab93e824f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-na5pyf7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='814f0703-fa5a-4a44-8dfb-91a9b9dcf091',image_min_disk='1',image_min_ram='0',image_owner_id='b013767d15ba4080b709cfd55431494b',image_owner_project_name='tempest-TestStampPattern-573014398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-573014398-project-member',image_user_id='736f23e5c24647bbb029d29a6f48cf38',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:31:28Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=6cc0527e-558f-4f75-b5a9-99e34bb85630,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "address": "fa:16:3e:a1:60:d8", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6aa76b1-68", "ovs_interfaceid": "f6aa76b1-6851-4a1f-8aff-2bd1809856c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG os_vif [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6aa76b1-68, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbc9e8b1-6f9e-4747-9eb9-b1189a400e17) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:28 user nova-compute[74721]: INFO os_vif [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:60:d8,bridge_name='br-int',has_traffic_filtering=True,id=f6aa76b1-6851-4a1f-8aff-2bd1809856c6,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6aa76b1-68')
Nov 02 23:34:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Deleting instance files /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630_del
Nov 02 23:34:28 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Deletion of /opt/stack/data/nova/instances/6cc0527e-558f-4f75-b5a9-99e34bb85630_del complete
Nov 02 23:34:28 user nova-compute[74721]: INFO nova.compute.manager [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 23:34:28 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:34:28 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:34:29 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:29 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Took 0.47 seconds to deallocate network for instance.
Nov 02 23:34:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:29 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:34:29 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:34:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:29 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Deleted allocations for instance 6cc0527e-558f-4f75-b5a9-99e34bb85630
Nov 02 23:34:29 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8b6ed2a0-5004-4fd1-92b1-755d7de9a161 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.755s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] Acquiring lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:30 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] Lock "6cc0527e-558f-4f75-b5a9-99e34bb85630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] No waiting events found dispatching network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:30 user nova-compute[74721]: WARNING nova.compute.manager [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received unexpected event network-vif-plugged-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 for instance with vm_state deleted and task_state None.
Nov 02 23:34:30 user nova-compute[74721]: DEBUG nova.compute.manager [req-873e804b-040c-48a9-9652-a88a48ee2158 req-d509e08b-1a30-4b64-87c9-debc98792e64 service nova] [instance: 6cc0527e-558f-4f75-b5a9-99e34bb85630] Received event network-vif-deleted-f6aa76b1-6851-4a1f-8aff-2bd1809856c6 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:38 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:42 user nova-compute[74721]: INFO nova.compute.manager [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Terminating instance
Nov 02 23:34:42 user nova-compute[74721]: DEBUG nova.compute.manager [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:42 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-unplugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] No waiting events found dispatching network-vif-unplugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-c90c3907-1999-4614-ba8b-d495343207ce req-a1eb875f-7c70-40a1-afd7-3c9a358f6182 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-unplugged-3df53505-3902-43ed-b04a-e8e2ad949548 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Instance destroyed successfully.
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.objects.instance [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid 90a900a7-735a-4be9-a265-8c26b703214f {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261719188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261719188',id=45,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-ik61wdqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:27:17Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=90a900a7-735a-4be9-a265-8c26b703214f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "3df53505-3902-43ed-b04a-e8e2ad949548", "address": "fa:16:3e:36:94:a3", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df53505-39", "ovs_interfaceid": "3df53505-3902-43ed-b04a-e8e2ad949548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG os_vif [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3df53505-39, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e74d45a2-b24f-4bc6-b49c-5d444385d347) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:43 user nova-compute[74721]: INFO os_vif [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:94:a3,bridge_name='br-int',has_traffic_filtering=True,id=3df53505-3902-43ed-b04a-e8e2ad949548,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df53505-39')
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Deleting instance files /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f_del
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Deletion of /opt/stack/data/nova/instances/90a900a7-735a-4be9-a265-8c26b703214f_del complete
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.compute.manager [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Took 0.43 seconds to deallocate network for instance.
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f41eef3-ad50-437f-9a0a-d7a420400e32 req-f6cbeff0-1cc1-4705-a333-e5a4c7c09682 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-deleted-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:43 user nova-compute[74721]: INFO nova.compute.manager [req-7f41eef3-ad50-437f-9a0a-d7a420400e32 req-f6cbeff0-1cc1-4705-a333-e5a4c7c09682 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Neutron deleted interface 3df53505-3902-43ed-b04a-e8e2ad949548; detaching it from the instance and deleting it from the info cache
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.network.neutron [req-7f41eef3-ad50-437f-9a0a-d7a420400e32 req-f6cbeff0-1cc1-4705-a333-e5a4c7c09682 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-7f41eef3-ad50-437f-9a0a-d7a420400e32 req-f6cbeff0-1cc1-4705-a333-e5a4c7c09682 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Detach interface failed, port_id=3df53505-3902-43ed-b04a-e8e2ad949548, reason: Instance 90a900a7-735a-4be9-a265-8c26b703214f could not be found. {{(pid=74721) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:44 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:34:44 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:34:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:44 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Deleted allocations for instance 90a900a7-735a-4be9-a265-8c26b703214f
Nov 02 23:34:44 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-515162ad-ec3f-463b-a407-54fa1210e29b tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "90a900a7-735a-4be9-a265-8c26b703214f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.545s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:34:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] Acquiring lock "90a900a7-735a-4be9-a265-8c26b703214f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:34:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:34:45 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] Lock "90a900a7-735a-4be9-a265-8c26b703214f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:34:45 user nova-compute[74721]: DEBUG nova.compute.manager [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] No waiting events found dispatching network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:34:45 user nova-compute[74721]: WARNING nova.compute.manager [req-b14ccc70-98e5-4ad8-8f0e-41491df04163 req-054057a6-aff4-49a1-b808-416789bf21e1 service nova] [instance: 90a900a7-735a-4be9-a265-8c26b703214f] Received unexpected event network-vif-plugged-3df53505-3902-43ed-b04a-e8e2ad949548 for instance with vm_state deleted and task_state None.
Nov 02 23:34:48 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquired lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Forcefully refreshing network info cache for instance {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG nova.network.neutron [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Releasing lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:34:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updated the network info_cache for instance {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 23:34:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:34:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:34:58 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:34:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:03 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:04 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:05 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:35:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74721) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:10 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:35:10 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=24.835880279541016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance b120c949-845c-47ad-a10b-602434960dae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:35:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:13 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing instance network info cache due to event network-changed-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] Acquiring lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] Acquired lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.network.neutron [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Refreshing network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:17 user nova-compute[74721]: INFO nova.compute.manager [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Terminating instance
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-unplugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] No waiting events found dispatching network-vif-unplugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:17 user nova-compute[74721]: DEBUG nova.compute.manager [req-488a966e-bf50-4734-93c5-02fa7f2b420c req-971a2003-5724-419d-a27e-8ba6efc68c0f service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-unplugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updated VIF entry in instance network info cache for port b1f5ca79-972d-4df3-8b4b-1cee04d5ae85. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.network.neutron [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating instance_info_cache with network_info: [{"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-335d6a17-2c1e-4bb7-9ea6-79e42dbbc48f req-d116766f-f0ba-4fe5-8add-12eb676ff027 service nova] Releasing lock "refresh_cache-8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Instance destroyed successfully.
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.objects.instance [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lazy-loading 'resources' on Instance uuid 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1901706543',display_name='tempest-TestVolumeBootPattern-server-1901706543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1901706543',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrLuqHitVbyOR7edHZHc4jWL1XxeAttNi4uG1AjR9T9VcjrzkmO4V8jAiirORYoc4isgm+JJiBmhu+ONfL+znORz6kPVUWiW2VxBi943PPUPvNBQs3Wcm4KPM2CHe89QQ==',key_name='tempest-TestVolumeBootPattern-74202561',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e6fd03271be4da382c041846492b561',ramdisk_id='',reservation_id='r-pq54m0yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1714088517',owner_user_name='tempest-TestVolumeBootPattern-1714088517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:30:33Z,user_data=None,user_id='3d0d084b45744960ad586bc68bfd81ab',uuid=8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converting VIF {"id": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "address": "fa:16:3e:fb:35:b0", "network": {"id": "d1c41086-7c3a-40db-b191-6a5925a81c4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-871789851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e6fd03271be4da382c041846492b561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f5ca79-97", "ovs_interfaceid": "b1f5ca79-972d-4df3-8b4b-1cee04d5ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_vif [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1f5ca79-97, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c900b86e-d368-4673-9413-eb55b7caf75d) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:18 user nova-compute[74721]: INFO os_vif [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:35:b0,bridge_name='br-int',has_traffic_filtering=True,id=b1f5ca79-972d-4df3-8b4b-1cee04d5ae85,network=Network(d1c41086-7c3a-40db-b191-6a5925a81c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f5ca79-97')
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhYaUQHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:35:18 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afddc16-e08d-408e-9f02-6013a3dcdc9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:35:18 user nova-compute[74721]: No targets found.
Nov 02 23:35:18 user nova-compute[74721]: iSNS:
Nov 02 23:35:18 user nova-compute[74721]: No targets found.
Nov 02 23:35:18 user nova-compute[74721]: STATIC:
Nov 02 23:35:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53
Nov 02 23:35:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:35:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:35:18 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:35:18 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:35:18 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:35:18 user nova-compute[74721]: FIRMWARE:
Nov 02 23:35:18 user nova-compute[74721]: No targets found.
Nov 02 23:35:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:35:18 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:35:18 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2d96c-890e-4949-bfe1-8d3e6796fa35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae74bf-5441-4941-ac42-b40b8766cea3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:35:18 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:35:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:35:18 user nova-compute[74721]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 (non-flash)
Nov 02 23:35:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf441ed000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53'): ({'sdc'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Removing single pathed devices sdc {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc6480-0d21-40a7-902d-c4d61a6e9a16]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60ab5bb-f150-45a6-a91d-80e954c4e58c]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Flushing IO for device /dev/sdc {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df2460b-c630-4238-9902-4e691d6f2590]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65c1a3-1940-4525-89bd-6d1ed5d4576b]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] SCSI volumes sdc have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f7e6ba4', '/dev/disk/by-id/scsi-1SCST_BIO9f7e6ba4-76a9219e721a3ce0', '/dev/disk/by-id/scsi-23736613932313965') {{(pid=86336) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57038e8-22d1-49f6-987e-d750f8e1c99b]: (4, None) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e588ce95-d7a3-4eb4-be16-78b09b268507]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18a7fd-daca-4409-88a3-e35b486644b2]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260]
Nov 02 23:35:18 user nova-compute[74721]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53, portal: 172.16.0.220,3260] successful.
Nov 02 23:35:18 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:776c1c64-888f-4081-996f-6562beb32c53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b4541-fdae-4775-a5c2-a6146064b6da]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] <== disconnect_volume: return (329ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:35:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Deleting instance files /opt/stack/data/nova/instances/8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce_del
Nov 02 23:35:18 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Deletion of /opt/stack/data/nova/instances/8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce_del complete
Nov 02 23:35:18 user nova-compute[74721]: INFO nova.compute.manager [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 02 23:35:18 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:35:18 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:35:19 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:35:19 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Took 0.44 seconds to deallocate network for instance.
Nov 02 23:35:19 user nova-compute[74721]: DEBUG nova.compute.manager [req-1f05c585-5ad2-4c07-b600-7c002b916b53 req-02b4f7b5-95cd-468f-931b-261a48d9101b service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-deleted-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] Acquiring lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG nova.compute.manager [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] No waiting events found dispatching network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:20 user nova-compute[74721]: WARNING nova.compute.manager [req-c071d201-8776-4110-a795-42cbeb06af36 req-f18185c8-c872-4386-b58b-8d111f0ebc92 service nova] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Received unexpected event network-vif-plugged-b1f5ca79-972d-4df3-8b4b-1cee04d5ae85 for instance with vm_state active and task_state deleting.
Nov 02 23:35:20 user nova-compute[74721]: INFO nova.compute.manager [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] [instance: 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce] Took 0.85 seconds to detach 1 volumes for instance.
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:20 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Deleted allocations for instance 8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce
Nov 02 23:35:20 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-0d511e80-c857-445a-ace7-bbb92d310638 tempest-TestVolumeBootPattern-1714088517 tempest-TestVolumeBootPattern-1714088517-project-member] Lock "8e6e611b-3ac1-4d08-aa2d-c5ff11dd9dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.855s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:23 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:28 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:33 user nova-compute[74721]: INFO nova.compute.manager [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Terminating instance
Nov 02 23:35:33 user nova-compute[74721]: DEBUG nova.compute.manager [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG nova.compute.manager [req-adcfd141-e087-47a0-818d-dc88179635fa req-9fd25da8-b5b3-44b3-bf0b-8ef3f2a346f9 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-unplugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:33 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Instance destroyed successfully.
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.objects.instance [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid b120c949-845c-47ad-a10b-602434960dae {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179948648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179948648',id=40,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-0zhn1xs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:23:33Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=b120c949-845c-47ad-a10b-602434960dae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "address": "fa:16:3e:07:cc:c9", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a2c67c-83", "ovs_interfaceid": "73a2c67c-8320-4a37-8512-cdcfcfcaf992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_vif [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73a2c67c-83, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a62cf995-4282-4fff-ac73-431328596421) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:34 user nova-compute[74721]: INFO os_vif [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:cc:c9,bridge_name='br-int',has_traffic_filtering=True,id=73a2c67c-8320-4a37-8512-cdcfcfcaf992,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a2c67c-83')
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] calling os-brick to detach iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdf247f0cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgdtDLEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 23:35:34 user nova-compute[74721]: WARNING os_brick.initiator.connectors.base [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f7183-3a16-45f2-8386-551b237462c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 23:35:34 user nova-compute[74721]: No targets found.
Nov 02 23:35:34 user nova-compute[74721]: iSNS:
Nov 02 23:35:34 user nova-compute[74721]: No targets found.
Nov 02 23:35:34 user nova-compute[74721]: STATIC:
Nov 02 23:35:34 user nova-compute[74721]: Target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39
Nov 02 23:35:34 user nova-compute[74721]:         Portal: 172.16.0.220:3260,-1
Nov 02 23:35:34 user nova-compute[74721]:                 Iface Name: default
Nov 02 23:35:34 user nova-compute[74721]: FIRMWARE:
Nov 02 23:35:34 user nova-compute[74721]: No targets found.
Nov 02 23:35:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 23:35:34 user nova-compute[74721]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 23:35:34 user nova-compute[74721]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74721) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39', 0)] {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20dbfd-28a1-4a46-bd06-276d771ba391]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1756d-cf3c-4ea3-b938-5fe6deeaf8cf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:35:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 (non-flash)
Nov 02 23:35:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdf24376cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39'): ({'sdb'}, set())}) {{(pid=74721) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Removing single pathed devices sdb {{(pid=74721) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7c6b0-a9c5-4b8e-a0ab-080d2a458827]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[794300b2-7162-4646-b1c3-330b491bf588]: (4, ('ok\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Flushing IO for device /dev/sdb {{(pid=74721) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d4730-dacc-4e66-af40-8b262a8ab4c2]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74721) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a710471-04e3-4522-a3cf-ddf0d7dc6d66]: (4, ('1', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.linuxscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] SCSI volumes sdb have been removed. {{(pid=74721) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39')] {{(pid=74721) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92cecd8-2b30-49b4-8b9e-0341ac663e48]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --logout {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da34e6ac-df10-4273-be55-be589733eeb2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260]
Nov 02 23:35:34 user nova-compute[74721]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39, portal: 172.16.0.220,3260] successful.
Nov 02 23:35:34 user nova-compute[74721]:  stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op delete {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066831a7-b79c-4fdd-86c1-16a0a4cceb39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e9e0e-080f-4b04-a85f-2bd4d342edc3]: (4, ('', '')) {{(pid=86336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74721) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.base [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] <== disconnect_volume: return (310ms) None {{(pid=74721) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Disconnected iSCSI Volume {{(pid=74721) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 23:35:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Deleting instance files /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae_del
Nov 02 23:35:34 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Deletion of /opt/stack/data/nova/instances/b120c949-845c-47ad-a10b-602434960dae_del complete
Nov 02 23:35:34 user nova-compute[74721]: INFO nova.compute.manager [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 02 23:35:34 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:35:34 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b120c949-845c-47ad-a10b-602434960dae] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:35:35 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: b120c949-845c-47ad-a10b-602434960dae] Took 0.45 seconds to deallocate network for instance.
Nov 02 23:35:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] Acquiring lock "b120c949-845c-47ad-a10b-602434960dae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] Lock "b120c949-845c-47ad-a10b-602434960dae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] No waiting events found dispatching network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:35 user nova-compute[74721]: WARNING nova.compute.manager [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received unexpected event network-vif-plugged-73a2c67c-8320-4a37-8512-cdcfcfcaf992 for instance with vm_state active and task_state deleting.
Nov 02 23:35:35 user nova-compute[74721]: DEBUG nova.compute.manager [req-8160b6bc-25f4-405a-ac87-0d00d986cfe9 req-d93f5a7e-6436-46b3-a7df-b53f32a325b2 service nova] [instance: b120c949-845c-47ad-a10b-602434960dae] Received event network-vif-deleted-73a2c67c-8320-4a37-8512-cdcfcfcaf992 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:35 user nova-compute[74721]: INFO nova.compute.manager [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: b120c949-845c-47ad-a10b-602434960dae] Took 0.83 seconds to detach 1 volumes for instance.
Nov 02 23:35:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:35 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:36 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:35:36 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:35:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:36 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Deleted allocations for instance b120c949-845c-47ad-a10b-602434960dae
Nov 02 23:35:36 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-37d22d1a-dcf9-4c34-96fd-6d8e2c2a8733 tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "b120c949-845c-47ad-a10b-602434960dae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.compute.manager [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing instance network info cache due to event network-changed-34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] Acquiring lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] Acquired lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Refreshing network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:40 user nova-compute[74721]: INFO nova.compute.manager [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Terminating instance
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.compute.manager [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updated VIF entry in instance network info cache for port 34f13e7b-2448-4acf-80ba-5973f6a9d877. {{(pid=74721) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG nova.network.neutron [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [{"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:35:40 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-0d606858-0557-47c3-89c4-1fc5dc40ad15 req-3d771dae-a36b-4352-9c2f-491e52b79780 service nova] Releasing lock "refresh_cache-814f0703-fa5a-4a44-8dfb-91a9b9dcf091" {{(pid=74721) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-unplugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] No waiting events found dispatching network-vif-unplugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.compute.manager [req-51262f50-782a-4e56-b78f-31a9f2dc6fff req-1a1000b3-b164-4915-b172-e2dfc7422070 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-unplugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:35:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Instance destroyed successfully.
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.objects.instance [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lazy-loading 'resources' on Instance uuid 814f0703-fa5a-4a44-8dfb-91a9b9dcf091 {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-718678891',display_name='tempest-TestStampPattern-server-718678891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-718678891',id=48,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKaHnLAmD3wbs/dXDLmnThSWTkJWDkTubRVWBKfFlKhm+au/7KKK1/0rgX+9/bVr3G1SmW0T8am9fTmmGFIryGyfogK9uEQVBXbXaMhaCkfdG9lEONZCI0ZfUaJ74XbDw==',key_name='tempest-TestStampPattern-1056081689',keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b013767d15ba4080b709cfd55431494b',ramdisk_id='',reservation_id='r-07w7jwuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-573014398',owner_user_name='tempest-TestStampPattern-573014398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:31:19Z,user_data=None,user_id='736f23e5c24647bbb029d29a6f48cf38',uuid=814f0703-fa5a-4a44-8dfb-91a9b9dcf091,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converting VIF {"id": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "address": "fa:16:3e:a8:55:77", "network": {"id": "637beabb-9b39-436c-8d3b-0c690d5f03b0", "bridge": "br-int", "label": "tempest-TestStampPattern-593389881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b013767d15ba4080b709cfd55431494b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f13e7b-24", "ovs_interfaceid": "34f13e7b-2448-4acf-80ba-5973f6a9d877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG os_vif [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f13e7b-24, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb0634ef-e25b-4b45-9a61-87c90fffe5ff) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:41 user nova-compute[74721]: INFO os_vif [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:55:77,bridge_name='br-int',has_traffic_filtering=True,id=34f13e7b-2448-4acf-80ba-5973f6a9d877,network=Network(637beabb-9b39-436c-8d3b-0c690d5f03b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f13e7b-24')
Nov 02 23:35:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Deleting instance files /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091_del
Nov 02 23:35:41 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Deletion of /opt/stack/data/nova/instances/814f0703-fa5a-4a44-8dfb-91a9b9dcf091_del complete
Nov 02 23:35:41 user nova-compute[74721]: INFO nova.compute.manager [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 23:35:41 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:35:41 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:35:42 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Took 0.47 seconds to deallocate network for instance.
Nov 02 23:35:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:42 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:35:42 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:35:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:42 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Deleted allocations for instance 814f0703-fa5a-4a44-8dfb-91a9b9dcf091
Nov 02 23:35:42 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-8229eee4-344a-48ac-a780-f5be5b6003c4 tempest-TestStampPattern-573014398 tempest-TestStampPattern-573014398-project-member] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] Acquiring lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:35:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:35:43 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] Lock "814f0703-fa5a-4a44-8dfb-91a9b9dcf091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:35:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] No waiting events found dispatching network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:35:43 user nova-compute[74721]: WARNING nova.compute.manager [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received unexpected event network-vif-plugged-34f13e7b-2448-4acf-80ba-5973f6a9d877 for instance with vm_state deleted and task_state None.
Nov 02 23:35:43 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbd5b0d2-5006-4dcd-97bd-a1357203d8de req-043e4d5b-e3c8-4dd1-81d9-ac4a04bbb831 service nova] [instance: 814f0703-fa5a-4a44-8dfb-91a9b9dcf091] Received event network-vif-deleted-34f13e7b-2448-4acf-80ba-5973f6a9d877 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:35:46 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:35:51 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:35:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:35:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:56 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:35:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:56 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:35:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:35:58 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:01 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:36:05 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:36:08 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.processutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74721) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 23:36:09 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:36:09 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.95987319946289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74721) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:36:09 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:11 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:16 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:24 user nova-compute[74721]: INFO nova.compute.manager [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Terminating instance
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.compute.manager [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Start destroying the instance on the hypervisor. {{(pid=74721) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-unplugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] No waiting events found dispatching network-vif-unplugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.compute.manager [req-b604fd22-553c-4a22-9925-c641849119d8 req-7d41c116-dbad-4370-a3f0-2f411ad50950 service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-unplugged-793333a8-a6ee-4153-92f5-ddd5eec61381 for instance with task_state deleting. {{(pid=74721) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 23:36:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Instance destroyed successfully.
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.objects.instance [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lazy-loading 'resources' on Instance uuid 3d3e49c8-ef70-4858-bf44-5d0b6be0816c {{(pid=74721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.virt.libvirt.vif [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T23:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-529454100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-529454100',id=38,image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T23:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b0a955207b54b909bf41ecfc6198291',ramdisk_id='',reservation_id='r-89566yr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf81f74d-ac5b-4b08-8444-661e551c1f11',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T23:18:44Z,user_data=None,user_id='c0b54b65445a47929910242fa7206851',uuid=3d3e49c8-ef70-4858-bf44-5d0b6be0816c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converting VIF {"id": "793333a8-a6ee-4153-92f5-ddd5eec61381", "address": "fa:16:3e:bf:8e:fc", "network": {"id": "d5a3917c-6427-479b-85db-4a58c3a4c715", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1446545379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b0a955207b54b909bf41ecfc6198291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793333a8-a6", "ovs_interfaceid": "793333a8-a6ee-4153-92f5-ddd5eec61381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.network.os_vif_util [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6') {{(pid=74721) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG os_vif [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6') {{(pid=74721) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap793333a8-a6, bridge=br-int, if_exists=True) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8556f746-7934-417e-8361-140ed5b5355c) {{(pid=74721) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:36:24 user nova-compute[74721]: INFO os_vif [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=793333a8-a6ee-4153-92f5-ddd5eec61381,network=Network(d5a3917c-6427-479b-85db-4a58c3a4c715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793333a8-a6')
Nov 02 23:36:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Deleting instance files /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c_del
Nov 02 23:36:24 user nova-compute[74721]: INFO nova.virt.libvirt.driver [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Deletion of /opt/stack/data/nova/instances/3d3e49c8-ef70-4858-bf44-5d0b6be0816c_del complete
Nov 02 23:36:24 user nova-compute[74721]: INFO nova.compute.manager [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 23:36:24 user nova-compute[74721]: DEBUG oslo.service.loopingcall [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74721) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.compute.manager [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Deallocating network for instance {{(pid=74721) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 23:36:24 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] deallocate_for_instance() {{(pid=74721) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG nova.network.neutron [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Updating instance_info_cache with network_info: [] {{(pid=74721) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 23:36:25 user nova-compute[74721]: INFO nova.compute.manager [-] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Took 0.68 seconds to deallocate network for instance.
Nov 02 23:36:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:36:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:25 user nova-compute[74721]: INFO nova.scheduler.client.report [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Deleted allocations for instance 3d3e49c8-ef70-4858-bf44-5d0b6be0816c
Nov 02 23:36:25 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-cedd49ff-ca52-4607-a62f-9cccc908ac0c tempest-ServerBootFromVolumeStableRescueTest-1796337083 tempest-ServerBootFromVolumeStableRescueTest-1796337083-project-member] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:36:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] Acquiring lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:36:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:36:26 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] Lock "3d3e49c8-ef70-4858-bf44-5d0b6be0816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:36:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] No waiting events found dispatching network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 23:36:26 user nova-compute[74721]: WARNING nova.compute.manager [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received unexpected event network-vif-plugged-793333a8-a6ee-4153-92f5-ddd5eec61381 for instance with vm_state deleted and task_state None.
Nov 02 23:36:26 user nova-compute[74721]: DEBUG nova.compute.manager [req-cbe7bf91-71fe-4efd-8735-6fb833b41c1f req-f6c26425-d5be-435e-aa5a-ae001631e2dc service nova] [instance: 3d3e49c8-ef70-4858-bf44-5d0b6be0816c] Received event network-vif-deleted-793333a8-a6ee-4153-92f5-ddd5eec61381 {{(pid=74721) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 23:36:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:47 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:53 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:36:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:36:53 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:36:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:36:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:57 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:36:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:36:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:36:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:07 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:37:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:10 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:37:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:37:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:37:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:37:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:37:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.0743408203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing inventories for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating ProviderTree inventory for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Updating inventory in ProviderTree for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing aggregate associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, aggregates: None {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Refreshing trait associations for resource provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS {{(pid=74721) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:11 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances with incomplete migration  {{(pid=74721) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 23:37:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:15 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:17 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:21 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:21 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Cleaning up deleted instances {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 23:37:21 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] There are 0 instances to clean {{(pid=74721) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 23:37:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:37:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:37:54 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:37:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:37:54 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:37:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:57 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:37:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:37:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:37:59 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:06 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:07 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:10 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:38:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:38:10 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:38:10 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:38:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:38:11 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.071430206298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:38:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:38:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:38:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:38:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:38:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:38:49 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:38:54 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:38:55 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Starting heal instance info cache {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 23:38:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Rebuilding the list of instances to heal {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 23:38:55 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Didn't find any instances for network info cache update. {{(pid=74721) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 23:38:56 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:57 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:57 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:38:57 user nova-compute[74721]: DEBUG nova.compute.manager [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74721) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 23:38:59 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:00 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:39:01 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:39:04 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:07 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:39:09 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:39:09 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:11 user nova-compute[74721]: DEBUG oslo_service.periodic_task [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Running periodic task ComputeManager.update_available_resource {{(pid=74721) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 23:39:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:39:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:39:11 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:39:11 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Auditing locally available compute resources for user (node: user) {{(pid=74721) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 23:39:12 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:39:12 user nova-compute[74721]: WARNING nova.virt.libvirt.driver [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.068843841552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74721) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74721) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.compute.provider_tree [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed in ProviderTree for provider: ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b {{(pid=74721) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.scheduler.client.report [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Inventory has not changed for provider ff237c8f-b265-4ffb-8f3f-9ce0ccfd965b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74721) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG nova.compute.resource_tracker [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Compute_service record updated for user:user {{(pid=74721) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 23:39:12 user nova-compute[74721]: DEBUG oslo_concurrency.lockutils [None req-5dec6724-ee7a-487a-91e9-d732859b59de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=74721) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74721) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74721) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 23:39:14 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:19 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:22 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:24 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:29 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:34 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 23:39:39 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 23:39:44 user nova-compute[74721]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74721) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}